Jul 21 17:08:43 devstack cinder-volume[76568]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 17:08:43 devstack cinder-volume[76568]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 17:08:43 devstack cinder-volume[76568]: we strongly recommend against using it for new projects. Jul 21 17:08:43 devstack cinder-volume[76568]: If you are already using Eventlet, we recommend migrating to a different Jul 21 17:08:43 devstack cinder-volume[76568]: framework. For more detail see Jul 21 17:08:43 devstack cinder-volume[76568]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 17:08:43 devstack cinder-volume[76568]: import eventlet # noqa Jul 21 17:08:46 devstack cinder-volume[76568]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76568) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:08:46 devstack cinder-volume[76568]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76568) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:08:46 devstack cinder-volume[76568]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76568) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:08:46 devstack cinder-volume[76568]: INFO dbcounter [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Registered counter for database cinder Jul 21 17:08:46 devstack cinder-volume[76568]: DEBUG oslo_db.sqlalchemy.engines [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:08:47 devstack cinder-volume[76568]: DEBUG dbcounter [-] [76568] Writer thread running {{(pid=76568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 17:08:47 devstack cinder-volume[76568]: INFO cinder.rpc [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 17:08:47 devstack cinder-volume[76568]: INFO cinder.rpc [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 17:08:47 devstack cinder-volume[76568]: DEBUG oslo_db.sqlalchemy.engines [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:08:47 devstack cinder-volume[76568]: INFO cinder.volume.manager [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Determined volume DB was empty at startup. Jul 21 17:08:47 devstack cinder-volume[76568]: DEBUG cinder.volume.manager [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76568) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 17:08:47 devstack cinder-volume[76568]: INFO cinder.volume.manager [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 17:08:47 devstack cinder-volume[76568]: WARNING stevedore.named [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 17:08:47 devstack cinder-volume[76568]: WARNING castellan.key_manager [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:08:47 devstack cinder-volume[76568]: WARNING cinder.keymgr.conf_key_mgr [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:08:47 devstack cinder-volume[76568]: DEBUG cinder.volume.drivers.lvm [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76568) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 21 17:08:47 devstack cinder-volume[76568]: DEBUG oslo_concurrency.processutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:47 devstack cinder-volume[76568]: DEBUG oslo_concurrency.processutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=76568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_db.sqlalchemy.engines [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:08:48 devstack cinder-volume[76568]: INFO cinder.rpc [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 21 17:08:48 devstack cinder-volume[76568]: INFO cinder.rpc [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 21 17:08:48 devstack cinder-volume[76568]: WARNING stevedore.named [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 17:08:48 devstack cinder-volume[76568]: WARNING castellan.key_manager [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:08:48 devstack cinder-volume[76568]: INFO cinder.volume.manager [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_db.sqlalchemy.engines [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:08:48 devstack cinder-volume[76568]: INFO oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Starting 1 workers Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Started child 76717 {{(pid=76568) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Full set of CONF: {{(pid=76568) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] ******************************************************************************** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Configuration options gathered from: {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] ================================================================================ {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] allow_availability_zone_fallback = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] allow_compression_on_image_upload = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] allowed_direct_url_schemes = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] api_rate_limit = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] auth_strategy = keystone {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] az_cache_duration = 3600 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_availability_zone = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_host = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_stats_polling_interval = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backup_api_class = cinder.backup.api.API {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backup_name_template = backup-%s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backup_use_same_host = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backup_use_temp_snapshot = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] chap_password = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] chap_username = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_internal_tenant_project_id = 4eeb4574e9bd4b84af053470706efe47 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_internal_tenant_user_id = 9d905fb64de94fc2b8291505dcebed5a {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cloned_volume_same_az = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cluster = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] compression_format = gzip {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] compute_api_class = cinder.compute.nova.API {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] config_dir = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] config_source = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] control_exchange = openstack {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] debug = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] default_availability_zone = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] default_group_type = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] default_volume_type = lvmdriver-1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] disk_geometry = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] driver_client_cert = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] driver_client_cert_key = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] driver_data_namespace = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] driver_ssl_cert_path = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] driver_ssl_cert_verify = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] driver_use_ssl = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] enable_force_upload = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] enable_new_services = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] enable_unsupported_driver = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] enforce_multipath_for_image_xfer = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] filter_function = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_api_insecure = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_api_ssl_compression = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_ca_certificates_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_catalog_info = image:glance:publicURL {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_num_retries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance_request_timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] goodness_function = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] graceful_shutdown_timeout = 5 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] group_api_class = cinder.group.api.API {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] host = devstack {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_compress_on_upload = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: INFO cinder.volume.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_conversion_address_space_limit = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_conversion_cpu_limit = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_conversion_disable = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_upload_use_cinder_backend = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_upload_use_internal_tenant = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_volume_cache_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_volume_cache_max_count = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] image_volume_cache_max_size_gb = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] init_host_max_objects_retrieval = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] instance_format = [instance: %(uuid)s] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] iscsi_target_flags = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] iscsi_write_cache = on {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] iser_helper = tgtadm {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] iser_ip_address = 192.168.122.125 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] iser_port = 3260 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_color = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_config_append = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_dir = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_options = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_rotate_interval = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_rotate_interval_type = days {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] log_rotation_type = none {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] max_age = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] max_logfile_count = 30 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] max_logfile_size_mb = 200 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] max_over_subscription_ratio = 20.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] message_reap_interval = 86400 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] message_ttl = 2592000 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] migration_create_volume_timeout_secs = 300 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] monkey_patch = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] monkey_patch_modules = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] my_ip = 192.168.122.125 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] no_snapshot_gb_quota = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] num_iser_scan_tries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] num_shell_tries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] num_volume_device_scan_tries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] nvmeof_conn_info_version = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] nvmet_ns_id = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] nvmet_port_id = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_max_limit = 1000 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_volume_ext_list = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_volume_listen_port = 8776 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_volume_use_ssl = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] osapi_volume_workers = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] per_volume_size_limit = -1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] periodic_fuzzy_delay = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] periodic_interval = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] public_endpoint = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] publish_errors = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_backup_gigabytes = 1000 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_backups = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_gigabytes = 1000 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_groups = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_snapshots = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] quota_volumes = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] rate_limit_burst = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] rate_limit_except_level = CRITICAL {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] rate_limit_interval = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] reinit_driver_count = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] replication_device = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] report_discard_supported = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] report_interval = 120 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] reservation_clean_interval = 86400 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] reservation_expire = 86400 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] reserved_image_namespaces = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] reserved_percentage = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] rpc_response_timeout = 120 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] run_external_periodic_tasks = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] scst_target_driver = iscsi {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] scst_target_iqn_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_down_time = 720 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] shell_completion = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] snapshot_name_template = snapshot-%s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] snapshot_same_host = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] split_loggers = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] state_path = /opt/stack/data/cinder {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] storage_availability_zone = nova {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] storage_protocol = iSCSI {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] syslog_log_facility = LOG_USER {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] target_helper = lioadm {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] target_ip_address = 192.168.122.125 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] target_port = 3260 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] target_protocol = iscsi {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] target_secondary_ip_addresses = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] trace_flags = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] transport_url = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] until_refresh = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_chap_auth = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_default_quota_class = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_journal = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_json = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_multipath_for_image_xfer = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_stderr = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] use_syslog = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] verify_glance_signatures = enabled {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_api_class = cinder.volume.api.API {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_backend_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_clear = zero {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_clear_ionice = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_clear_size = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_copy_bps_limit = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_dd_blocksize = 1M {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_name_template = volume-%s {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_service_inithost_offload = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volume_usage_audit_period = month {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] zoning_mode = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_concurrency.disable_process_locking = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.auth_section = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.auth_type = password {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.auth_version = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.cache = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack sudo[76724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 21 17:08:48 devstack sudo[76724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.include_service_catalog = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.insecure = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.interface = public {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_password = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcache_username = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.region_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.service_type = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.backend = dogpile.cache.null {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.backend_argument = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.backend_expiration_time = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.config_prefix = cache.oslo {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.debug_cache_backend = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.enable_retry_client = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.enable_socket_keepalive = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.expiration_time = 600 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.hashclient_retry_attempts = 2 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_dead_retry = 300 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_pool_maxsize = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_sasl_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.password = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.proxies = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.redis_db = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.redis_server = localhost:6379 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.retry_attempts = 2 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.retry_delay = 0.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.socket_keepalive_count = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.socket_keepalive_idle = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.socket_keepalive_interval = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.socket_timeout = 1.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.tls_allowed_ciphers = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.tls_cafile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.tls_certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.tls_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.tls_keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cache.username = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] coordination.backend_url = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.asyncio_connection = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.asyncio_slave_connection = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.backend = sqlalchemy {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.connection = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.connection_debug = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.connection_parameters = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.connection_recycle_time = 3600 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.connection_trace = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.db_inc_retry_interval = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.db_max_retries = 20 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.db_max_retry_interval = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.db_retry_interval = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.max_overflow = 50 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.max_pool_size = 5 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.max_retries = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.mysql_wsrep_sync_wait = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.pool_timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.retry_interval = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.slave_connection = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.sqlite_synchronous = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.synchronous_reader = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] database.use_db_reconnect = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.connection_string = messaging:// {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.es_doc_type = notification {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.es_scroll_size = 10000 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.es_scroll_time = 2m {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.filter_error_trace = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.hmac_keys = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.sentinel_service_name = mymaster {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.socket_timeout = 0.1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.trace_requests = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler.trace_sqlalchemy = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler_jaeger.process_tags = {} {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler_jaeger.service_name_prefix = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] profiler_otlp.service_name_prefix = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.enforce_new_defaults = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.policy_default_rule = default {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.policy_file = policy.yaml {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.group = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.helper_command = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] privsep_osbrick.user = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.group = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.helper_command = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] cinder_sys_admin.user = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.auth_section = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.auth_type = password {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.cafile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.collect_timing = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.insecure = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.send_service_user_token = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.split_loggers = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] service_user.timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.auth_section = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.auth_type = password {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.collect_timing = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.insecure = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.region_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.split_loggers = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] glance.timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.backend_availability_zone = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.chap_password = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.chap_username = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.disk_geometry = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.driver_client_cert = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.driver_client_cert_key = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.driver_data_namespace = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.driver_use_ssl = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.extra_capabilities = {} {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.filter_function = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.goodness_function = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.iscsi_target_flags = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.iscsi_write_cache = on {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.iser_helper = tgtadm {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.iser_port = 3260 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.lvm_share_target = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.lvm_type = auto {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.num_shell_tries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.replication_device = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.report_discard_supported = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.reserved_percentage = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.target_helper = tgtadm {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.target_port = 3260 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.target_protocol = iscsi {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.trace_flags = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.unique_fqdn_network = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.use_chap_auth = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_backend_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_clear = zero {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_clear_ionice = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_clear_size = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_reports.file_event_handler = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_reports.log_dir = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.backend_host = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.chap_password = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.chap_username = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.disk_geometry = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.driver_client_cert = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.extra_capabilities = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.filter_function = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.goodness_function = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.iser_helper = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.iser_ip_address = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.iser_port = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.lvm_share_target = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.lvm_type = auto {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.num_shell_tries = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.replication_device = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.report_discard_supported = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.reserved_percentage = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.scst_target_driver = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.storage_protocol = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.target_helper = lioadm {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.target_ip_address = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.target_port = 3260 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.trace_flags = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.use_chap_auth = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_clear = zero {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_clear_size = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] lvmdriver-1.volumes_dir = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_notifications.driver = [] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_notifications.retry = -1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] key_manager.fixed_key = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.barbican_api_version = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.barbican_endpoint = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.barbican_endpoint_type = public {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.barbican_region_name = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.cafile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.collect_timing = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.insecure = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.number_of_retries = 60 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.retry_delay = 1 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.send_service_user_token = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.split_loggers = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.verify_ssl = True {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican.verify_ssl_path = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.auth_section = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.auth_type = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.cafile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.certfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.collect_timing = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.insecure = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.keyfile = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.split_loggers = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] barbican_service_user.timeout = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.approle_role_id = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.approle_secret_id = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.auth_method = approle {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.auth_path = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.kv_mountpoint = secret {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.kv_path = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.kv_version = 2 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.namespace = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.root_token_id = **** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.ssl_ca_crt_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.timeout = 60.0 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.token_file = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.token_role = None {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.use_ssl = False {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:08:48 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] ******************************************************************************** {{(pid=76568) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 17:08:48 devstack sudo[76724]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:48 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:48 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:08:48 devstack cinder-volume[76717]: INFO cinder.brick.local_dev.lvm [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:48 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:48 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:08:48 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:49 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG cinder.brick.local_dev.lvm [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76717) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:49 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:49 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:49 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:49 devstack sudo[77211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:49 devstack sudo[77211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:49 devstack sudo[77211]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:49 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:49 devstack sudo[77329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 21 17:08:49 devstack sudo[77329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:50 devstack sudo[77329]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:50 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:50 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:50 devstack sudo[77332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:08:50 devstack sudo[77332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:50 devstack sudo[77332]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:50 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:50 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:50 devstack sudo[77415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:08:50 devstack sudo[77415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:50 devstack sudo[77415]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:50 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:50 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:50 devstack sudo[77418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:50 devstack sudo[77418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:51 devstack sudo[77418]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:51 devstack sudo[77450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:51 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:51 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:51 devstack sudo[77511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:51 devstack sudo[77511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:51 devstack sudo[77511]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:51 devstack cinder-volume[76717]: INFO cinder.volume.drivers.lvm [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:51 devstack sudo[77515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:51 devstack sudo[77515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:51 devstack sudo[77515]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG cinder.volume.drivers.lvm [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Updating volume stats {{(pid=76717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 17:08:51 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:51 devstack sudo[77524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:08:51 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:52 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:52 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:52 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:52 devstack sudo[77527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:52 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:52 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:52 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:52 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:52 devstack sudo[77530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:52 devstack sudo[77530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:52 devstack sudo[77530]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:52 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:52 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:52 devstack sudo[77533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:52 devstack sudo[77533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:53 devstack sudo[77533]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:53 devstack cinder-volume[76717]: INFO cinder.volume.driver [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG cinder.volume.driver [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76717) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_db.sqlalchemy.engines [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writer thread running {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG cinder.db.api [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Building query based on filter {{(pid=76717) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG cinder.image.image_utils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76717) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 17:08:53 devstack cinder-volume[76717]: INFO cinder.keymgr.migration [None req-05a84e6d-1aa9-4d54-bb02-946a2d063643 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG cinder.volume.drivers.lvm [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Updating volume stats {{(pid=76717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:53 devstack sudo[77536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:08:53 devstack sudo[77536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:53 devstack sudo[77536]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:53 devstack sudo[77542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:53 devstack sudo[77542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:53 devstack sudo[77542]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:53 devstack sudo[77545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:53 devstack sudo[77545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:53 devstack sudo[77545]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:53 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:54 devstack sudo[77548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:54 devstack sudo[77548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:54 devstack sudo[77548]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG cinder.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Notifying Schedulers of capabilities ... {{(pid=76717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:08:54 devstack cinder-volume[76717]: INFO cinder.volume.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Driver initialization completed successfully. Jul 21 17:08:54 devstack cinder-volume[76717]: INFO cinder.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Initiating service 2 cleanup Jul 21 17:08:54 devstack cinder-volume[76717]: INFO cinder.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Service 2 cleanup completed. Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG cinder.service [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Creating RPC server for service cinder-volume {{(pid=76717) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG cinder.service [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76717) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 17:08:54 devstack cinder-volume[76717]: INFO cinder.volume.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG cinder.volume.drivers.lvm [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Updating volume stats {{(pid=76717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:54 devstack sudo[77553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:08:54 devstack sudo[77553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:54 devstack sudo[77553]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:54 devstack sudo[77556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:54 devstack sudo[77556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:54 devstack sudo[77556]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:54 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:55 devstack sudo[77559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:08:55 devstack sudo[77559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:55 devstack sudo[77559]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:55 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:55 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:08:55 devstack sudo[77565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:08:55 devstack sudo[77565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:08:55 devstack sudo[77565]: pam_unix(sudo:session): session closed for user root Jul 21 17:08:55 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:08:55 devstack cinder-volume[76717]: INFO cinder.volume.manager [None req-dae2a94a-9788-4b73-b65f-248e8082c4e9 None None] Driver post RPC initialization completed successfully. Jul 21 17:08:58 devstack cinder-volume[76568]: DEBUG dbcounter [-] [76568] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:09:05 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writing DB stats cinder:SELECT=2 {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:09:05 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:09:33 devstack cinder-volume[76717]: DEBUG oslo_service.periodic_task [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running periodic task VolumeManager._thread_info {{(pid=76717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:09:33 devstack cinder-volume[76717]: DEBUG cinder.volume.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] thread count: 6 {{(pid=76717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:09:33 devstack cinder-volume[76717]: DEBUG cinder.volume.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] thread info: [<_MainThread(MainThread, started 123976923521152)>, , , , , ] {{(pid=76717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:10:33 devstack cinder-volume[76717]: DEBUG oslo_service.periodic_task [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:10:33 devstack cinder-volume[76717]: DEBUG cinder.volume.drivers.lvm [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Updating volume stats {{(pid=76717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 17:10:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:10:33 devstack sudo[82756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:10:33 devstack sudo[82756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:10:33 devstack sudo[82756]: pam_unix(sudo:session): session closed for user root Jul 21 17:10:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:10:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:10:33 devstack sudo[82759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:10:33 devstack sudo[82759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:10:34 devstack sudo[82759]: pam_unix(sudo:session): session closed for user root Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:10:34 devstack sudo[82762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:10:34 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:10:34 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:10:34 devstack sudo[82765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:10:34 devstack sudo[82765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:10:34 devstack sudo[82765]: pam_unix(sudo:session): session closed for user root Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG cinder.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Notifying Schedulers of capabilities ... {{(pid=76717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG oslo_service.periodic_task [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running periodic task VolumeManager._thread_info {{(pid=76717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG cinder.volume.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] thread count: 6 {{(pid=76717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:10:34 devstack cinder-volume[76717]: DEBUG cinder.volume.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] thread info: [<_MainThread(MainThread, started 123976923521152)>, , , , , ] {{(pid=76717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:11:05 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writing DB stats cinder:SELECT=1 {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:11:05 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writing DB stats cinder:UPDATE=1 {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:11:33 devstack cinder-volume[76717]: DEBUG oslo_service.periodic_task [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:11:33 devstack cinder-volume[76717]: DEBUG cinder.volume.drivers.lvm [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Updating volume stats {{(pid=76717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 17:11:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:11:33 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:11:33 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:11:33 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Jul 21 17:11:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:11:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:11:33 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:11:33 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:11:34 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Jul 21 17:11:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:11:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:11:34 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:11:34 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:11:34 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Jul 21 17:11:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:11:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:11:34 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:11:34 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:11:34 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Jul 21 17:11:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:11:34 devstack cinder-volume[76717]: DEBUG cinder.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Notifying Schedulers of capabilities ... {{(pid=76717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:12:33 devstack cinder-volume[76717]: DEBUG oslo_service.periodic_task [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:12:33 devstack cinder-volume[76717]: DEBUG cinder.volume.drivers.lvm [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Updating volume stats {{(pid=76717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 17:12:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:12:33 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 17:12:33 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:12:33 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Jul 21 17:12:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:12:33 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:12:33 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:12:33 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:12:34 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:12:34 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 17:12:34 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:12:34 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:12:34 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 17:12:34 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:12:34 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG oslo_concurrency.processutils [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG cinder.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Notifying Schedulers of capabilities ... {{(pid=76717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG oslo_service.periodic_task [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] Running periodic task VolumeManager._thread_info {{(pid=76717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG cinder.volume.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] thread count: 6 {{(pid=76717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:12:34 devstack cinder-volume[76717]: DEBUG cinder.volume.manager [None req-3f310378-aa42-4653-8bf7-ed52799adebb None None] thread info: [<_MainThread(MainThread, started 123976923521152)>, , , , , ] {{(pid=76717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:13:05 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writing DB stats cinder:SELECT=1 {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:13:05 devstack cinder-volume[76717]: DEBUG dbcounter [-] [76717] Writing DB stats cinder:UPDATE=1 {{(pid=76717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:13:17 devstack cinder-volume[76568]: INFO oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Caught SIGTERM, stopping children Jul 21 17:13:17 devstack cinder-volume[76568]: DEBUG oslo_concurrency.lockutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Acquiring lock "singleton_lock" {{(pid=76568) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:13:17 devstack cinder-volume[76568]: DEBUG oslo_concurrency.lockutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Acquired lock "singleton_lock" {{(pid=76568) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:13:17 devstack cinder-volume[76568]: DEBUG oslo_concurrency.lockutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Releasing lock "singleton_lock" {{(pid=76568) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:13:17 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Stop services. {{(pid=76568) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 17:13:17 devstack cinder-volume[76568]: DEBUG oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Killing children. {{(pid=76568) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 17:13:17 devstack cinder-volume[76568]: INFO oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Waiting on 1 children to exit Jul 21 17:13:19 devstack cinder-volume[76717]: DEBUG oslo_concurrency.lockutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Acquiring lock "singleton_lock" {{(pid=76717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:13:19 devstack cinder-volume[76717]: DEBUG oslo_concurrency.lockutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Acquired lock "singleton_lock" {{(pid=76717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:13:19 devstack cinder-volume[76717]: DEBUG oslo_concurrency.lockutils [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Releasing lock "singleton_lock" {{(pid=76717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:13:19 devstack cinder-volume[76717]: WARNING amqp [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 17:13:19 devstack cinder-volume[76717]: WARNING amqp [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 17:13:19 devstack cinder-volume[76568]: INFO oslo_service.backend._eventlet.service [None req-d7936287-30ba-45da-98b3-9e83d7518c04 None None] Child 76717 exited with status 0 Jul 21 17:13:19 devstack cinder-volume[86785]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 17:13:19 devstack cinder-volume[86785]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 17:13:19 devstack cinder-volume[86785]: we strongly recommend against using it for new projects. Jul 21 17:13:19 devstack cinder-volume[86785]: If you are already using Eventlet, we recommend migrating to a different Jul 21 17:13:19 devstack cinder-volume[86785]: framework. For more detail see Jul 21 17:13:19 devstack cinder-volume[86785]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 17:13:19 devstack cinder-volume[86785]: import eventlet # noqa Jul 21 17:13:21 devstack cinder-volume[86785]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:13:21 devstack cinder-volume[86785]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:13:21 devstack cinder-volume[86785]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:13:22 devstack cinder-volume[86785]: INFO dbcounter [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Registered counter for database cinder Jul 21 17:13:22 devstack cinder-volume[86785]: DEBUG oslo_db.sqlalchemy.engines [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG dbcounter [-] [86785] Writer thread running {{(pid=86785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 17:13:23 devstack cinder-volume[86785]: INFO cinder.rpc [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 17:13:23 devstack cinder-volume[86785]: INFO cinder.rpc [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_db.sqlalchemy.engines [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:23 devstack cinder-volume[86785]: INFO cinder.volume.manager [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Determined volume DB was empty at startup. Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG cinder.volume.manager [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86785) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 17:13:23 devstack cinder-volume[86785]: INFO cinder.volume.manager [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 17:13:23 devstack cinder-volume[86785]: WARNING stevedore.named [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 17:13:23 devstack cinder-volume[86785]: WARNING castellan.key_manager [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:13:23 devstack cinder-volume[86785]: WARNING cinder.keymgr.conf_key_mgr [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:13:23 devstack cinder-volume[86785]: INFO cinder.volume.manager [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_db.sqlalchemy.engines [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:23 devstack cinder-volume[86785]: INFO oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Starting 1 workers Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Started child 87000 {{(pid=86785) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Full set of CONF: {{(pid=86785) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] ******************************************************************************** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Configuration options gathered from: {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 17:13:23 devstack cinder-volume[87000]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] ================================================================================ {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] allow_availability_zone_fallback = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] allow_compression_on_image_upload = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] allowed_direct_url_schemes = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] api_rate_limit = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] auth_strategy = keystone {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_availability_zone = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_host = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_stats_polling_interval = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backup_api_class = cinder.backup.api.API {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backup_name_template = backup-%s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backup_use_same_host = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backup_use_temp_snapshot = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] chap_password = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] chap_username = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_internal_tenant_project_id = 4eeb4574e9bd4b84af053470706efe47 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_internal_tenant_user_id = 9d905fb64de94fc2b8291505dcebed5a {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cluster = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] compression_format = gzip {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] compute_api_class = cinder.compute.nova.API {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] config_dir = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] config_source = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] control_exchange = openstack {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] debug = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] default_availability_zone = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] default_group_type = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] default_volume_type = QuobyteHD {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] disk_geometry = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] driver_client_cert = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] driver_client_cert_key = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] driver_data_namespace = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] driver_ssl_cert_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] driver_ssl_cert_verify = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] driver_use_ssl = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] enable_new_services = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] enable_unsupported_driver = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] enabled_backends = ['QuobyteHD'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] enforce_multipath_for_image_xfer = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] filter_function = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_api_insecure = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_api_ssl_compression = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_ca_certificates_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_catalog_info = image:glance:publicURL {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_num_retries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance_request_timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] goodness_function = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] graceful_shutdown_timeout = 5 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] group_api_class = cinder.group.api.API {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] host = devstack {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_compress_on_upload = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_conversion_address_space_limit = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_conversion_cpu_limit = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_conversion_disable = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_upload_use_cinder_backend = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_upload_use_internal_tenant = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_volume_cache_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_volume_cache_max_count = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] image_volume_cache_max_size_gb = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] init_host_max_objects_retrieval = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] instance_format = [instance: %(uuid)s] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] iscsi_target_flags = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] iscsi_write_cache = on {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] iser_helper = tgtadm {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] iser_ip_address = 192.168.122.125 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] iser_port = 3260 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_color = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_config_append = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_dir = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_options = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_rotate_interval = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_rotate_interval_type = days {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] log_rotation_type = none {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] max_age = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] max_logfile_count = 30 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] max_logfile_size_mb = 200 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] max_over_subscription_ratio = 20.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] message_reap_interval = 86400 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] message_ttl = 2592000 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] migration_create_volume_timeout_secs = 300 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] monkey_patch = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] monkey_patch_modules = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] my_ip = 192.168.122.125 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] no_snapshot_gb_quota = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] num_iser_scan_tries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] num_shell_tries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] num_volume_device_scan_tries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] nvmeof_conn_info_version = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] nvmet_ns_id = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] nvmet_port_id = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_max_limit = 1000 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_volume_ext_list = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_volume_listen_port = 8776 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_volume_use_ssl = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] osapi_volume_workers = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] per_volume_size_limit = -1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] periodic_fuzzy_delay = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] periodic_interval = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[87000]: INFO cinder.volume.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.remotefs [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87000) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] public_endpoint = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] publish_errors = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_backup_gigabytes = 1000 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_backups = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_gigabytes = 1000 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_groups = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_snapshots = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] quota_volumes = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] rate_limit_burst = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] rate_limit_except_level = CRITICAL {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] rate_limit_interval = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] reinit_driver_count = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] replication_device = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] report_discard_supported = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] report_interval = 120 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] reservation_clean_interval = 86400 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] reservation_expire = 86400 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] reserved_image_namespaces = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] reserved_percentage = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] rpc_response_timeout = 120 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] run_external_periodic_tasks = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] scst_target_driver = iscsi {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] scst_target_iqn_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_down_time = 720 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] shell_completion = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] snapshot_name_template = snapshot-%s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] split_loggers = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] state_path = /opt/stack/data/cinder {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] storage_availability_zone = nova {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] storage_protocol = iSCSI {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] syslog_log_facility = LOG_USER {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] target_helper = lioadm {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] target_ip_address = 192.168.122.125 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] target_port = 3260 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] target_protocol = iscsi {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] target_secondary_ip_addresses = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] trace_flags = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] transport_url = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] until_refresh = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_chap_auth = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_default_quota_class = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_journal = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_json = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_multipath_for_image_xfer = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_stderr = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] use_syslog = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] verify_glance_signatures = enabled {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_api_class = cinder.volume.api.API {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_backend_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_clear = zero {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_clear_ionice = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_clear_size = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_copy_bps_limit = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_dd_blocksize = 1M {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_name_template = volume-%s {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_service_inithost_offload = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volume_usage_audit_period = month {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] zoning_mode = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_concurrency.disable_process_locking = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.auth_section = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.auth_type = password {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.auth_version = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.cache = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.include_service_catalog = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.insecure = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87000) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.interface = public {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: WARNING cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: WARNING cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_password = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Running cmd (subprocess): mount.quobyte {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcache_username = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.region_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.service_type = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.backend = dogpile.cache.null {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.backend_argument = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.backend_expiration_time = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.config_prefix = cache.oslo {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.debug_cache_backend = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.enable_retry_client = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.enable_socket_keepalive = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.expiration_time = 600 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.hashclient_retry_attempts = 2 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_dead_retry = 300 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_pool_maxsize = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_sasl_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.password = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.proxies = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.redis_db = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.redis_server = localhost:6379 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.retry_attempts = 2 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.retry_delay = 0.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.socket_keepalive_count = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.socket_keepalive_idle = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.socket_keepalive_interval = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.socket_timeout = 1.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.tls_allowed_ciphers = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.tls_cafile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.tls_certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.tls_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.tls_keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cache.username = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] coordination.backend_url = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.asyncio_connection = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.asyncio_slave_connection = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.backend = sqlalchemy {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.connection = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.connection_debug = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.connection_parameters = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.connection_recycle_time = 3600 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.connection_trace = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.db_inc_retry_interval = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.db_max_retries = 20 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.db_max_retry_interval = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.db_retry_interval = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.max_overflow = 50 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.max_pool_size = 5 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.max_retries = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.mysql_wsrep_sync_wait = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.pool_timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.retry_interval = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.slave_connection = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.sqlite_synchronous = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.synchronous_reader = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] database.use_db_reconnect = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.connection_string = messaging:// {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.es_doc_type = notification {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.es_scroll_size = 10000 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.es_scroll_time = 2m {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.filter_error_trace = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.hmac_keys = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.sentinel_service_name = mymaster {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.socket_timeout = 0.1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.trace_requests = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler.trace_sqlalchemy = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler_jaeger.process_tags = {} {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack quobyte-client[87005]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 17:13:23 devstack quobyte-client[87005]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler_jaeger.service_name_prefix = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] profiler_otlp.service_name_prefix = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.enforce_new_defaults = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.policy_default_rule = default {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.policy_file = policy.yaml {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[87000]: INFO cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 ... Jul 21 17:13:23 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 -c /etc/quobyte/client-cinder.cfg {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.group = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.helper_command = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] privsep_osbrick.user = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.group = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.helper_command = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] cinder_sys_admin.user = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.auth_section = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.auth_type = password {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.cafile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.collect_timing = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.insecure = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.send_service_user_token = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.split_loggers = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] service_user.timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.auth_section = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.auth_type = password {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 -c /etc/quobyte/client-cinder.cfg Jul 21 17:13:23 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.collect_timing = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.insecure = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.region_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.split_loggers = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] glance.timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.backend_availability_zone = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.chap_password = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.chap_username = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.disk_geometry = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.driver_client_cert = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.driver_client_cert_key = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.driver_data_namespace = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.driver_use_ssl = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.extra_capabilities = {} {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.filter_function = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.goodness_function = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.iscsi_target_flags = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.iscsi_write_cache = on {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.iser_helper = tgtadm {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.iser_port = 3260 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_host = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_login = admin {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_mount_options = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_password = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_private_key = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_share_path = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.num_shell_tries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.quobyte_volume_url = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.replication_device = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.report_discard_supported = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.reserved_percentage = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.target_helper = tgtadm {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.target_port = 3260 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.target_protocol = iscsi {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.trace_flags = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.unique_fqdn_network = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.use_chap_auth = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_backend_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_clear = zero {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_clear_ionice = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_clear_size = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_reports.file_event_handler = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_reports.log_dir = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.backend_availability_zone = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.backend_host = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.chap_password = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.chap_username = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.chiscsi_conf = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.disk_geometry = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.driver_client_cert = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.driver_data_namespace = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.driver_use_ssl = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.extra_capabilities = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.filter_function = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.goodness_function = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.iser_helper = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.iser_ip_address = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.iser_port = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.iser_target_prefix = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_host = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_login = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_mount_options = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_password = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_private_key = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_share_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_ssh_port = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.num_shell_tries = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.nvmet_port_id = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.replication_device = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.report_discard_supported = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.reserved_percentage = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.scst_target_driver = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.storage_protocol = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.target_helper = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.target_ip_address = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.target_port = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.target_prefix = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.target_protocol = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.trace_flags = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.use_chap_auth = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_clear = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_clear_size = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] QuobyteHD.volumes_dir = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_notifications.driver = [] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_notifications.retry = -1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] key_manager.fixed_key = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.barbican_api_version = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.barbican_endpoint = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.barbican_endpoint_type = public {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.barbican_region_name = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.cafile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.collect_timing = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.insecure = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.number_of_retries = 60 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.retry_delay = 1 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.send_service_user_token = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.split_loggers = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.verify_ssl = True {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican.verify_ssl_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.auth_section = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.auth_type = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.cafile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.certfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.collect_timing = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.insecure = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.keyfile = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.split_loggers = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] barbican_service_user.timeout = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.approle_role_id = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.approle_secret_id = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.auth_method = approle {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.auth_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.kv_mountpoint = secret {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.kv_path = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.kv_version = 2 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.namespace = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.root_token_id = **** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.ssl_ca_crt_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.timeout = 60.0 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.token_file = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.token_role = None {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.use_ssl = False {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:23 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] ******************************************************************************** {{(pid=86785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 17:13:24 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.378s {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 succeeded Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.388s {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:24 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:13:24 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:24 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.240s {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.volume.driver [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.volume.driver [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87000) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_db.sqlalchemy.engines [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG dbcounter [-] [87000] Writer thread running {{(pid=87000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.db.api [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Building query based on filter {{(pid=87000) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.image.image_utils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87000) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.keymgr.migration [None req-77e15c82-b3b5-47b9-8cd8-7fc5adefb9ad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:24 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:13:24 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:24 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.229s {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Notifying Schedulers of capabilities ... {{(pid=87000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.volume.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Driver initialization completed successfully. Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Initiating service 3 cleanup Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Service 3 cleanup completed. Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.service [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Creating RPC server for service cinder-volume {{(pid=87000) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.service [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87000) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 17:13:24 devstack cinder-volume[87000]: INFO cinder.volume.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG cinder.volume.drivers.quobyte [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:13:24 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:24 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:13:24 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:25 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:25 devstack cinder-volume[87000]: DEBUG oslo_concurrency.processutils [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.255s {{(pid=87000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:25 devstack cinder-volume[87000]: INFO cinder.volume.manager [None req-92d42357-5f5a-4fe2-838c-74a83e8c8876 None None] Driver post RPC initialization completed successfully. Jul 21 17:13:29 devstack cinder-volume[86785]: INFO oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Caught SIGTERM, stopping children Jul 21 17:13:29 devstack cinder-volume[86785]: DEBUG oslo_concurrency.lockutils [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Acquiring lock "singleton_lock" {{(pid=86785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:13:29 devstack cinder-volume[86785]: DEBUG oslo_concurrency.lockutils [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Acquired lock "singleton_lock" {{(pid=86785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:13:29 devstack cinder-volume[86785]: DEBUG oslo_concurrency.lockutils [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Releasing lock "singleton_lock" {{(pid=86785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:13:29 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Stop services. {{(pid=86785) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 17:13:29 devstack cinder-volume[86785]: DEBUG oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Killing children. {{(pid=86785) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 17:13:29 devstack cinder-volume[86785]: INFO oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Waiting on 1 children to exit Jul 21 17:13:33 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Acquiring lock "singleton_lock" {{(pid=87000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:13:33 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Acquired lock "singleton_lock" {{(pid=87000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:13:33 devstack cinder-volume[87000]: DEBUG oslo_concurrency.lockutils [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Releasing lock "singleton_lock" {{(pid=87000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:13:33 devstack cinder-volume[87000]: WARNING amqp [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 17:13:33 devstack cinder-volume[87000]: WARNING amqp [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 17:13:33 devstack cinder-volume[86785]: INFO oslo_service.backend._eventlet.service [None req-5ff65f73-8bb1-4de1-a582-5a284c295acb None None] Child 87000 exited with status 0 Jul 21 17:13:33 devstack cinder-volume[87283]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 17:13:33 devstack cinder-volume[87283]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 17:13:33 devstack cinder-volume[87283]: we strongly recommend against using it for new projects. Jul 21 17:13:33 devstack cinder-volume[87283]: If you are already using Eventlet, we recommend migrating to a different Jul 21 17:13:33 devstack cinder-volume[87283]: framework. For more detail see Jul 21 17:13:33 devstack cinder-volume[87283]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 17:13:33 devstack cinder-volume[87283]: import eventlet # noqa Jul 21 17:13:36 devstack cinder-volume[87283]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 17:13:36 devstack cinder-volume[87283]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 17:13:36 devstack cinder-volume[87283]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 17:13:37 devstack cinder-volume[87283]: INFO dbcounter [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Registered counter for database cinder Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_db.sqlalchemy.engines [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG dbcounter [-] [87283] Writer thread running {{(pid=87283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 17:13:37 devstack cinder-volume[87283]: INFO cinder.rpc [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 17:13:37 devstack cinder-volume[87283]: INFO cinder.rpc [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_db.sqlalchemy.engines [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:37 devstack cinder-volume[87283]: INFO cinder.volume.manager [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Determined volume DB was empty at startup. Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG cinder.volume.manager [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87283) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 17:13:37 devstack cinder-volume[87283]: WARNING stevedore.named [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 17:13:37 devstack cinder-volume[87283]: WARNING castellan.key_manager [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:13:37 devstack cinder-volume[87283]: WARNING cinder.keymgr.conf_key_mgr [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 17:13:37 devstack cinder-volume[87283]: INFO cinder.volume.manager [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_db.sqlalchemy.engines [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:37 devstack cinder-volume[87283]: INFO oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Starting 1 workers Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Started child 87591 {{(pid=87283) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Full set of CONF: {{(pid=87283) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] ******************************************************************************** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] Configuration options gathered from: {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] ================================================================================ {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] allow_availability_zone_fallback = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] allow_compression_on_image_upload = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] allowed_direct_url_schemes = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] api_rate_limit = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] auth_strategy = keystone {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_availability_zone = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_host = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_stats_polling_interval = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backup_api_class = cinder.backup.api.API {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87591]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backup_name_template = backup-%s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backup_use_same_host = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backup_use_temp_snapshot = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] chap_password = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] chap_username = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_internal_tenant_project_id = 4eeb4574e9bd4b84af053470706efe47 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_internal_tenant_user_id = 9d905fb64de94fc2b8291505dcebed5a {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cluster = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] compression_format = gzip {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] compute_api_class = cinder.compute.nova.API {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] config_dir = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] config_source = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] control_exchange = openstack {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] debug = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] default_availability_zone = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] default_group_type = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] default_volume_type = QuobyteHD {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] disk_geometry = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] driver_client_cert = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] driver_client_cert_key = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] driver_data_namespace = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] driver_ssl_cert_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] driver_ssl_cert_verify = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] driver_use_ssl = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] enable_new_services = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] enable_unsupported_driver = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] enabled_backends = ['QuobyteHD'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] enforce_multipath_for_image_xfer = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] filter_function = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_api_insecure = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_api_ssl_compression = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_ca_certificates_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_catalog_info = image:glance:publicURL {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_num_retries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance_request_timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] goodness_function = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] graceful_shutdown_timeout = 5 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] group_api_class = cinder.group.api.API {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] host = devstack {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_compress_on_upload = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_conversion_address_space_limit = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_conversion_cpu_limit = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_conversion_disable = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_upload_use_cinder_backend = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_upload_use_internal_tenant = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_volume_cache_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_volume_cache_max_count = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] image_volume_cache_max_size_gb = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] init_host_max_objects_retrieval = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] instance_format = [instance: %(uuid)s] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] iscsi_target_flags = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] iscsi_write_cache = on {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] iser_helper = tgtadm {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] iser_ip_address = 192.168.122.125 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] iser_port = 3260 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_color = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_config_append = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_dir = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_options = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_rotate_interval = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_rotate_interval_type = days {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] log_rotation_type = none {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] max_age = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] max_logfile_count = 30 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] max_logfile_size_mb = 200 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] max_over_subscription_ratio = 20.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] message_reap_interval = 86400 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] message_ttl = 2592000 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] migration_create_volume_timeout_secs = 300 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] monkey_patch = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] monkey_patch_modules = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] my_ip = 192.168.122.125 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] no_snapshot_gb_quota = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] num_iser_scan_tries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] num_shell_tries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] num_volume_device_scan_tries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] nvmeof_conn_info_version = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] nvmet_ns_id = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] nvmet_port_id = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_max_limit = 1000 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_volume_ext_list = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_volume_listen = 0.0.0.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_volume_listen_port = 8776 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_volume_use_ssl = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] osapi_volume_workers = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] per_volume_size_limit = -1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] periodic_fuzzy_delay = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] periodic_interval = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] project_id_regex = [0-9a-f\-]+ {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] public_endpoint = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] publish_errors = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a0863052-49dc-47f1-a438-14b326728801 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87591) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_backup_gigabytes = 1000 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_backups = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_gigabytes = 1000 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_groups = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_snapshots = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] quota_volumes = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] rate_limit_burst = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] rate_limit_except_level = CRITICAL {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] rate_limit_interval = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] reinit_driver_count = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] replication_device = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] report_discard_supported = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] report_interval = 120 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] reservation_clean_interval = 86400 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] reservation_expire = 86400 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] reserved_image_namespaces = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] reserved_percentage = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] rpc_response_timeout = 120 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] run_external_periodic_tasks = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] scst_target_driver = iscsi {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] scst_target_iqn_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_down_time = 720 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] shell_completion = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] snapshot_name_template = snapshot-%s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] split_loggers = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] state_path = /opt/stack/data/cinder {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] storage_availability_zone = nova {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] storage_protocol = iSCSI {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] syslog_log_facility = LOG_USER {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] target_helper = lioadm {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] target_ip_address = 192.168.122.125 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] target_port = 3260 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] target_protocol = iscsi {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] target_secondary_ip_addresses = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] trace_flags = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] transfer_api_class = cinder.transfer.api.API {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] transport_url = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] until_refresh = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_chap_auth = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_default_quota_class = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_journal = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_json = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_multipath_for_image_xfer = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_stderr = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] use_syslog = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] verify_glance_signatures = enabled {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:37 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_api_class = cinder.volume.api.API {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_backend_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_clear = zero {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_clear_ionice = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_clear_size = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_copy_bps_limit = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_dd_blocksize = 1M {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_name_template = volume-%s {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_service_inithost_offload = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volume_usage_audit_period = month {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] zoning_mode = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_concurrency.disable_process_locking = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.auth_section = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.auth_type = password {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.auth_version = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.cache = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.delay_auth_decision = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.http_connect_timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.include_service_catalog = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.insecure = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.interface = public {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_password = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcache_username = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.region_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.service_token_roles_required = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.service_type = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.token_cache_time = 300 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.backend = dogpile.cache.null {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.backend_argument = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.backend_expiration_time = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.config_prefix = cache.oslo {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.debug_cache_backend = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.enable_retry_client = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.enable_socket_keepalive = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.expiration_time = 600 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.hashclient_retry_attempts = 2 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_dead_retry = 300 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_pool_maxsize = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_sasl_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.password = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.proxies = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.redis_db = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.redis_sentinel_service_name = mymaster {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.redis_server = localhost:6379 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.retry_attempts = 2 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.retry_delay = 0.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.socket_keepalive_count = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87591) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.socket_keepalive_idle = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.socket_keepalive_interval = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.socket_timeout = 1.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.tls_allowed_ciphers = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.tls_cafile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.tls_certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Running cmd (subprocess): mount.quobyte {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.tls_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.tls_keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cache.username = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] coordination.backend_url = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.asyncio_connection = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.asyncio_slave_connection = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.backend = sqlalchemy {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.connection = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.connection_debug = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.connection_parameters = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.connection_recycle_time = 3600 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.connection_trace = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.db_inc_retry_interval = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.db_max_retries = 20 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.db_max_retry_interval = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.db_retry_interval = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.max_overflow = 50 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.max_pool_size = 5 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.max_retries = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.mysql_wsrep_sync_wait = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.pool_timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.retry_interval = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.slave_connection = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.sqlite_synchronous = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.synchronous_reader = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] database.use_db_reconnect = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.connection_string = messaging:// {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.es_doc_type = notification {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.es_scroll_size = 10000 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.es_scroll_time = 2m {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.filter_error_trace = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.hmac_keys = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.sentinel_service_name = mymaster {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.socket_timeout = 0.1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.trace_requests = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler.trace_sqlalchemy = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler_jaeger.process_tags = {} {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler_jaeger.service_name_prefix = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] profiler_otlp.service_name_prefix = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.enforce_new_defaults = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.policy_default_rule = default {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.policy_file = policy.yaml {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_policy.remote_timeout = 60.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.group = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.helper_command = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] privsep_osbrick.user = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.group = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.helper_command = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] cinder_sys_admin.user = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.auth_section = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.auth_type = password {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.cafile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.collect_timing = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.insecure = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.send_service_user_token = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.split_loggers = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] service_user.timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.auth_section = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.auth_type = password {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.collect_timing = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.insecure = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.region_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.split_loggers = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] glance.timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.backend_availability_zone = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.chap_password = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.chap_username = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.disk_geometry = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.driver_client_cert = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.driver_client_cert_key = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.driver_data_namespace = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.driver_use_ssl = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.enable_unsupported_driver = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.extra_capabilities = {} {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.filter_function = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.goodness_function = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.iscsi_target_flags = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.iscsi_write_cache = on {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.iser_helper = tgtadm {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack quobyte-client[87592]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 17:13:38 devstack quobyte-client[87592]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.iser_port = 3260 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_host = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_login = admin {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_mount_options = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_password = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] CMD "mount.quobyte" returned: 1 in 0.048s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_private_key = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_share_path = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_ssh_port = 22 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.num_shell_tries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.nvmet_port_id = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_client_cfg = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.quobyte_volume_url = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.replication_device = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.report_discard_supported = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.reserved_percentage = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.scst_target_driver = iscsi {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.scst_target_iqn_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.storage_protocol = iSCSI {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.target_helper = tgtadm {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.target_port = 3260 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.target_protocol = iscsi {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.trace_flags = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.unique_fqdn_network = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.use_chap_auth = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_backend_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_clear = zero {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_clear_ionice = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_clear_size = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_reports.file_event_handler = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_reports.log_dir = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.backend_availability_zone = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.backend_host = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.chap_password = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.chap_username = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.chiscsi_conf = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.disk_geometry = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.driver_client_cert = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.driver_client_cert_key = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.driver_data_namespace = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.driver_use_ssl = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.extra_capabilities = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.filter_function = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.goodness_function = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.iscsi_target_flags = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.iscsi_write_cache = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.iser_helper = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.iser_ip_address = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.iser_port = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.iser_target_prefix = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_host = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_login = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_mount_options = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_password = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_private_key = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_share_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_ssh_port = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.num_shell_tries = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nvmet_ns_id = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.nvmet_port_id = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.replication_device = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.report_discard_supported = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.reserved_percentage = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.scst_target_driver = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.storage_protocol = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.target_helper = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.target_ip_address = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.target_port = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.target_prefix = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.target_protocol = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.trace_flags = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.unique_fqdn_network = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.use_chap_auth = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_clear = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_clear_ionice = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_clear_size = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] QuobyteHD.volumes_dir = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.ssl_version = {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_notifications.driver = [] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_notifications.retry = -1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] oslo_messaging_notifications.transport_url = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] key_manager.fixed_key = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.barbican_api_version = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.barbican_endpoint = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.barbican_endpoint_type = public {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.barbican_region_name = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.cafile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.collect_timing = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.insecure = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.number_of_retries = 60 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.retry_delay = 1 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.send_service_user_token = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.split_loggers = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.verify_ssl = True {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican.verify_ssl_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.auth_section = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.auth_type = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.cafile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.certfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.collect_timing = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.insecure = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.keyfile = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.split_loggers = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] barbican_service_user.timeout = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.approle_role_id = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.approle_secret_id = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.auth_method = approle {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.auth_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.kv_mountpoint = secret {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.kv_path = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.kv_version = 2 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.namespace = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.root_token_id = **** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.ssl_ca_crt_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.timeout = 60.0 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.token_file = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.token_role = None {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.use_ssl = False {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 17:13:38 devstack cinder-volume[87283]: DEBUG oslo_service.backend._eventlet.service [None req-28445cd9-b52f-4144-9e64-b2d114cacbeb None None] ******************************************************************************** {{(pid=87283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 17:13:38 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:38 devstack cinder-volume[87591]: INFO cinder.volume.driver [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.driver [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87591) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_db.sqlalchemy.engines [None req-a0863052-49dc-47f1-a438-14b326728801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writer thread running {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.db.api [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Building query based on filter {{(pid=87591) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87591) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:38 devstack cinder-volume[87591]: INFO cinder.keymgr.migration [None req-294df38d-ebb1-43a7-9934-dbccb47870ef None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 17:13:38 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:13:38 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:38 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.235s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:13:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Driver initialization completed successfully. Jul 21 17:13:38 devstack cinder-volume[87591]: INFO cinder.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Initiating service 3 cleanup Jul 21 17:13:38 devstack cinder-volume[87591]: INFO cinder.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Service 3 cleanup completed. Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.service [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Creating RPC server for service cinder-volume {{(pid=87591) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.service [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87591) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 17:13:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:13:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:13:38 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:13:38 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:13:39 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Jul 21 17:13:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0863052-49dc-47f1-a438-14b326728801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.225s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:13:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a0863052-49dc-47f1-a438-14b326728801 None None] Driver post RPC initialization completed successfully. Jul 21 17:13:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:13:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 6 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:13:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:13:47 devstack cinder-volume[87283]: DEBUG dbcounter [-] [87283] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:13:48 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:13:49 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=3 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Flow 'volume_create_manager' (f6cb0656-c28c-4c30-8f1f-5cca4ea8e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ff8c01-3ed7-4e84-b889-8a453948b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ff8c01-3ed7-4e84-b889-8a453948b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1525498175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b333a764e1db420eb7b67ab9b2fbc38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:14:36Z,use_quota=True,user_id='228c4222ed664b9aa5757fe4ee5008b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b83980-0514-43ef-8d0f-094d9a41e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b83980-0514-43ef-8d0f-094d9a41e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520de744-9f10-4679-ae66-978c5d3949dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520de744-9f10-4679-ae66-978c5d3949dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87', 'volume_name': 'volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff8b424-4a3d-4bf3-bc83-27ae52b5a17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff8b424-4a3d-4bf3-bc83-27ae52b5a17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050b9500-d247-468d-bde5-1afe2895ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:14:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Volume ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87', 'volume_size': 1} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1525498175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b333a764e1db420eb7b67ab9b2fbc38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:14:36Z,use_quota=True,user_id='228c4222ed664b9aa5757fe4ee5008b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Creating volume ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:14:36 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:14:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:14:36 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 1073741824 Jul 21 17:14:36 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:14:37 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 1073741824" returned: 0 in 0.709s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:14:37 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 Jul 21 17:14:37 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:14:37 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87" returned: 0 in 0.397s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050b9500-d247-468d-bde5-1afe2895ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a639dde6-7c70-4890-8a43-529e5bb9e98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:14:37 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Volume volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 (ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87): created successfully Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a639dde6-7c70-4890-8a43-529e5bb9e98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:14:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Flow 'volume_create_manager' (f6cb0656-c28c-4c30-8f1f-5cca4ea8e725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:14:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b24dc264-cd9d-4151-b687-5be800a561b2 tempest-TaggedAttachmentsTest-386702580 None] Created volume successfully. Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:14:42 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:14:42 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:14:42 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.407s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 6 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:14:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:14:47 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:14:47 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Flow 'volume_create_manager' (5a63ec37-d782-4bd1-86a8-defb627cdc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce2aa20-63a2-4025-bc26-22332dd2b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce2aa20-63a2-4025-bc26-22332dd2b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-314284064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bbf9c7-a71b-48d4-9190-cb03d1f33882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f7e285e86f4d10826258a6b7407bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:15:05Z,use_quota=True,user_id='b699badfed6f4d918cbca93a63648758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b40b8b0-1db4-4d08-a914-62fffe91459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b40b8b0-1db4-4d08-a914-62fffe91459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32acca5-af6d-4dfe-a896-2b81a5de71a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32acca5-af6d-4dfe-a896-2b81a5de71a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3bbf9c7-a71b-48d4-9190-cb03d1f33882', 'volume_name': 'volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f0fadf-d339-47b5-abc5-aea822a83021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f0fadf-d339-47b5-abc5-aea822a83021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649bc18d-551c-474d-b028-caa187e470a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Volume b3bbf9c7-a71b-48d4-9190-cb03d1f33882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882', 'volume_size': 1} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-314284064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bbf9c7-a71b-48d4-9190-cb03d1f33882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f7e285e86f4d10826258a6b7407bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:15:05Z,use_quota=True,user_id='b699badfed6f4d918cbca93a63648758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Creating volume b3bbf9c7-a71b-48d4-9190-cb03d1f33882 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:15:05 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:15:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:05 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 1073741824 Jul 21 17:15:05 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:06 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 1073741824" returned: 0 in 0.859s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:06 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 Jul 21 17:15:06 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:06 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649bc18d-551c-474d-b028-caa187e470a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f549a3a6-c2ab-402d-a063-ccaca9476e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:06 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Volume volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 (b3bbf9c7-a71b-48d4-9190-cb03d1f33882): created successfully Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f549a3a6-c2ab-402d-a063-ccaca9476e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Flow 'volume_create_manager' (5a63ec37-d782-4bd1-86a8-defb627cdc50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:15:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-bdb288ea-f168-43c6-964c-0f6af4d8cd90 tempest-VolumesAdminNegativeTest-636684572 None] Created volume successfully. Jul 21 17:15:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Acquiring lock "cinder-b3bbf9c7-a71b-48d4-9190-cb03d1f33882-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:15:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Lock "cinder-b3bbf9c7-a71b-48d4-9190-cb03d1f33882-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:15:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Acquiring lock "cinder-quobyte-b3bbf9c7-a71b-48d4-9190-cb03d1f33882" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:15:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Lock "cinder-quobyte-b3bbf9c7-a71b-48d4-9190-cb03d1f33882" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:15:08 devstack cinder-volume[87591]: INFO oslo.privsep.daemon [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6esw5byt/privsep.sock'] Jul 21 17:15:08 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6esw5byt/privsep.sock Jul 21 17:15:08 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 17:15:10 devstack cinder-volume[87591]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 21 17:15:10 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:10 devstack cinder-volume[87591]: INFO oslo.privsep.daemon [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Spawned new privsep daemon via rootwrap Jul 21 17:15:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Accepted privsep connection to /tmp/tmp6esw5byt/privsep.sock {{(pid=87591) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 21 17:15:10 devstack cinder-volume[87591]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 21 17:15:10 devstack cinder-volume[87591]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 21 17:15:10 devstack cinder-volume[87591]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 21 17:15:10 devstack cinder-volume[87591]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88752 Jul 21 17:15:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ff561a-392d-4acf-832b-3264a8cbb55f]: (2,) {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:15:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7965a4-d82a-470d-b319-dfa039038904]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:15:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:11 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 Jul 21 17:15:11 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:11 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882" returned: 0 in 0.699s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:11 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882 Jul 21 17:15:11 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:12 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b3bbf9c7-a71b-48d4-9190-cb03d1f33882" returned: 0 in 0.450s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Lock "cinder-quobyte-b3bbf9c7-a71b-48d4-9190-cb03d1f33882" released by "delete_volume" :: held 3.668s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:15:12 devstack cinder-volume[87591]: WARNING cinder.quota [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:15:12 devstack cinder-volume[87591]: WARNING cinder.quota [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Created reservations ['74c45e92-a5ee-44e4-bb53-223f24e44fd8', '2a0b2321-9e4a-46f7-9f58-c94a26cc44ea', '32c4ae12-8f96-4bd3-b1cc-1d0c48f47c77', '9ecd9e40-63d4-4c7c-a784-b2b3a36759d5'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:12 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:15:12 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:12 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.408s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:15:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Deleted volume successfully. Jul 21 17:15:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9a9d5e65-ba4c-4bf3-823a-fb05323ecca7 tempest-VolumesAdminNegativeTest-636684572 None] Lock "cinder-b3bbf9c7-a71b-48d4-9190-cb03d1f33882-delete_volume" released by "delete_volume" :: held 4.601s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:15:22 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:15:22 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Flow 'volume_create_manager' (92de20d5-7f63-4d7f-b41d-5d53087b46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1d26cf-1f38-4d89-9688-a5b686a1f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1d26cf-1f38-4d89-9688-a5b686a1f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1731944140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a10fb8-a9f9-4153-9069-18993b0a52e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc99c7b01d0440fd9728dd19838589ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:15:23Z,use_quota=True,user_id='d6afe210c7f74b2abc7151941348c5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4ea530-a27c-4078-885f-e1c152c58eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4ea530-a27c-4078-885f-e1c152c58eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3497e80d-aada-4b26-a2a7-f5a333f2efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3497e80d-aada-4b26-a2a7-f5a333f2efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a10fb8-a9f9-4153-9069-18993b0a52e4', 'volume_name': 'volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57f0911-7cbf-47bf-b665-8b828ce706d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57f0911-7cbf-47bf-b665-8b828ce706d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e624b48-3a86-4149-a2b3-fa5f2809b12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Volume f4a10fb8-a9f9-4153-9069-18993b0a52e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4', 'volume_size': 1} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1731944140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a10fb8-a9f9-4153-9069-18993b0a52e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc99c7b01d0440fd9728dd19838589ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:15:23Z,use_quota=True,user_id='d6afe210c7f74b2abc7151941348c5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Creating volume f4a10fb8-a9f9-4153-9069-18993b0a52e4 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:15:23 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:23 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 1073741824 Jul 21 17:15:23 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:23 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 1073741824" returned: 0 in 0.521s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:23 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 Jul 21 17:15:23 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:24 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4" returned: 0 in 0.264s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e624b48-3a86-4149-a2b3-fa5f2809b12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16bb0aa-6773-4c67-8ec7-f0980d0d77db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Volume volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 (f4a10fb8-a9f9-4153-9069-18993b0a52e4): created successfully Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16bb0aa-6773-4c67-8ec7-f0980d0d77db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Flow 'volume_create_manager' (92de20d5-7f63-4d7f-b41d-5d53087b46bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:15:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f4862c05-b425-4cee-817c-1ede07bd5822 tempest-AttachVolumeShelveTestJSON-2055017111 None] Created volume successfully. Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Flow 'volume_create_manager' (21976eef-773c-4a61-bb51-16f34bac4995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e9a51-bf6f-4807-b494-a668be63da54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e9a51-bf6f-4807-b494-a668be63da54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-884013282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4e0cf2-c6d3-40a9-86a6-f21fccf73841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672fd5efb15b4453a93158b0ccac11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:15:34Z,use_quota=True,user_id='e4ca4c8616764ec0b1db806a2d2b42ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0151e7-aad7-4639-a97f-b4f2ec20b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0151e7-aad7-4639-a97f-b4f2ec20b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff31734-89ef-4e47-b47f-09c7075a7509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff31734-89ef-4e47-b47f-09c7075a7509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c4e0cf2-c6d3-40a9-86a6-f21fccf73841', 'volume_name': 'volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c995d276-8d7b-450e-a34a-b6c457d7bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c995d276-8d7b-450e-a34a-b6c457d7bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85ff0f7-779d-425f-9889-f1e0c968915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:34 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Volume 4c4e0cf2-c6d3-40a9-86a6-f21fccf73841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841', 'volume_size': 1} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-884013282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4e0cf2-c6d3-40a9-86a6-f21fccf73841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672fd5efb15b4453a93158b0ccac11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:15:34Z,use_quota=True,user_id='e4ca4c8616764ec0b1db806a2d2b42ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Creating volume 4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:15:34 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:15:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:34 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 1073741824 Jul 21 17:15:34 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:35 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 1073741824" returned: 0 in 0.998s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:35 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 Jul 21 17:15:35 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:35 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841" returned: 0 in 0.350s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:15:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85ff0f7-779d-425f-9889-f1e0c968915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef24809e-2cba-4d95-aaf2-d8fa0e9edef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:15:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Volume volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 (4c4e0cf2-c6d3-40a9-86a6-f21fccf73841): created successfully Jul 21 17:15:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef24809e-2cba-4d95-aaf2-d8fa0e9edef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:15:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Flow 'volume_create_manager' (21976eef-773c-4a61-bb51-16f34bac4995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:15:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-cac839f0-2b0a-4f78-b9b6-3bcef78b3b35 tempest-DeleteServersTestJSON-349570233 None] Created volume successfully. Jul 21 17:15:41 devstack cinder-volume[87591]: WARNING py.warnings [req-5f28d3ed-7249-4f14-96fd-c905c0cc79f0 req-ba326144-81c9-4156-a2b9-7683f71346c3 tempest-AttachVolumeShelveTestJSON-2055017111 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 21 17:15:41 devstack cinder-volume[87591]: .first() Jul 21 17:15:41 devstack cinder-volume[87591]: Jul 21 17:15:41 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-5f28d3ed-7249-4f14-96fd-c905c0cc79f0 req-ba326144-81c9-4156-a2b9-7683f71346c3 tempest-AttachVolumeShelveTestJSON-2055017111 None] No connector for attachment 01c26f92-f0fb-4899-a620-a39540dd8b50; skipping storage backend terminate_connection call. {{(pid=87591) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 21 17:15:41 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-5f28d3ed-7249-4f14-96fd-c905c0cc79f0 req-ba326144-81c9-4156-a2b9-7683f71346c3 tempest-AttachVolumeShelveTestJSON-2055017111 None] Deleting attachment 01c26f92-f0fb-4899-a620-a39540dd8b50. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:42 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:15:42 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-a663d2b1-7f55-4993-8d1a-f367b88a483d req-64a9f35a-3e48-4920-bdc5-4963af32982f tempest-DeleteServersTestJSON-349570233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-a663d2b1-7f55-4993-8d1a-f367b88a483d req-64a9f35a-3e48-4920-bdc5-4963af32982f tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-a663d2b1-7f55-4993-8d1a-f367b88a483d req-64a9f35a-3e48-4920-bdc5-4963af32982f tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:42 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.756s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-a663d2b1-7f55-4993-8d1a-f367b88a483d req-64a9f35a-3e48-4920-bdc5-4963af32982f tempest-DeleteServersTestJSON-349570233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4af4ef8-589b-4f2a-862a-9a555e85f954', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-ee1212bb-deeb-4d64-9926-c19ddd4bf514 req-c29e32d0-fa20-41c5-b510-a98447789962 tempest-TaggedAttachmentsTest-386702580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-ee1212bb-deeb-4d64-9926-c19ddd4bf514 req-c29e32d0-fa20-41c5-b510-a98447789962 tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-ee1212bb-deeb-4d64-9926-c19ddd4bf514 req-c29e32d0-fa20-41c5-b510-a98447789962 tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-ee1212bb-deeb-4d64-9926-c19ddd4bf514 req-c29e32d0-fa20-41c5-b510-a98447789962 tempest-TaggedAttachmentsTest-386702580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '566b5d7c-97da-4e57-a865-cd0d33e7c848', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:15:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-a663d2b1-7f55-4993-8d1a-f367b88a483d req-64a9f35a-3e48-4920-bdc5-4963af32982f tempest-DeleteServersTestJSON-349570233 None] attachment_update completed successfully. Jul 21 17:15:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-ee1212bb-deeb-4d64-9926-c19ddd4bf514 req-c29e32d0-fa20-41c5-b510-a98447789962 tempest-TaggedAttachmentsTest-386702580 None] attachment_update completed successfully. Jul 21 17:15:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-a91b0cad-301c-42ef-884f-b12f088bde0f req-97ca33b5-c643-4d62-b4ac-1495d10fbd11 tempest-DeleteServersTestJSON-349570233 None] Terminate volume connection completed successfully. Jul 21 17:15:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-a91b0cad-301c-42ef-884f-b12f088bde0f req-97ca33b5-c643-4d62-b4ac-1495d10fbd11 tempest-DeleteServersTestJSON-349570233 None] Deleting attachment f4af4ef8-589b-4f2a-862a-9a555e85f954. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:15:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-56502dda-ea5c-4a94-8d7d-47b248b6ba2b req-228db30a-ea8e-4021-ac05-13eea1652e66 tempest-TaggedAttachmentsTest-386702580 None] Terminate volume connection completed successfully. Jul 21 17:15:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-56502dda-ea5c-4a94-8d7d-47b248b6ba2b req-228db30a-ea8e-4021-ac05-13eea1652e66 tempest-TaggedAttachmentsTest-386702580 None] Deleting attachment 566b5d7c-97da-4e57-a865-cd0d33e7c848. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:15:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Acquiring lock "cinder-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:15:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Lock "cinder-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:15:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Acquiring lock "cinder-quobyte-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:15:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Lock "cinder-quobyte-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:15:51 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f9099-e30f-46c5-b17d-b3f93e1b526d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:15:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:51 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 Jul 21 17:15:51 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:52 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841" returned: 0 in 0.447s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:52 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841 Jul 21 17:15:52 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:52 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841" returned: 0 in 0.318s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Lock "cinder-quobyte-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841" released by "delete_volume" :: held 0.866s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Created reservations ['ef642b6b-a3a2-4ac7-9c4a-afb57f3d6c9d', '35568eda-561f-478a-be67-98de06206a23', 'dfd7d35f-adb3-4214-a80d-d70baa26dc5a', '2c029829-edb6-47c9-975b-ee5df9c3bbcc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:15:52 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:15:52 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:15:52 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.321s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:15:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Deleted volume successfully. Jul 21 17:15:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2ba0532d-4390-4948-a002-8c1e42592bc0 tempest-DeleteServersTestJSON-349570233 None] Lock "cinder-4c4e0cf2-c6d3-40a9-86a6-f21fccf73841-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:16:02 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=29,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:16:02 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=15,cinder:SELECT=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:16:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Acquiring lock "cinder-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:16:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Lock "cinder-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:16:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Acquiring lock "cinder-quobyte-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:16:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Lock "cinder-quobyte-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:16:07 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[128d6464-3920-41fa-86c1-8e49863fe11b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:16:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:07 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 Jul 21 17:16:07 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:08 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:08 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87 Jul 21 17:16:08 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:08 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87" returned: 0 in 0.282s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Lock "cinder-quobyte-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87" released by "delete_volume" :: held 0.823s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Created reservations ['bc236f88-9d2f-43df-a50c-4091484d9f95', '1ebd0bad-9955-4446-875d-952d56333294', 'b4d12d10-d0d1-46f5-8214-7d5c1239567f', '1ec5226e-5663-442b-96f0-28a39d91b1ac'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:16:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:08 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:16:08 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:09 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.630s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:09 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:16:09 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Deleted volume successfully. Jul 21 17:16:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e490e64-04c8-4c1b-ba7f-884c4e6938aa tempest-TaggedAttachmentsTest-386702580 None] Lock "cinder-ad3bdb21-4f0f-4453-b8d6-c3e5dc122c87-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:16:18 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=11 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:16:19 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Acquiring lock "cinder-f4a10fb8-a9f9-4153-9069-18993b0a52e4-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "cinder-f4a10fb8-a9f9-4153-9069-18993b0a52e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Acquiring lock "cinder-quobyte-f4a10fb8-a9f9-4153-9069-18993b0a52e4" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "cinder-quobyte-f4a10fb8-a9f9-4153-9069-18993b0a52e4" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4930d674-2e7d-4389-a68c-69fef4b97098]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:30 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 Jul 21 17:16:30 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:30 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4" returned: 0 in 0.498s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:30 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4 Jul 21 17:16:30 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:31 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4a10fb8-a9f9-4153-9069-18993b0a52e4" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "cinder-quobyte-f4a10fb8-a9f9-4153-9069-18993b0a52e4" released by "delete_volume" :: held 1.043s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Created reservations ['e42e3171-bd64-4762-b8e0-9008dafc1ea5', '4c96d606-248d-4640-bb11-dbcc28754b66', 'b8d91e0d-4de7-4c98-88f9-b76d791c174c', '37cd2da9-89cd-4dc5-8417-d6f841ac5b4a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:16:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:31 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:16:31 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:32 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.539s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:32 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:16:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Deleted volume successfully. Jul 21 17:16:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31040936-7785-4564-8532-546cb5cd9f6e tempest-AttachVolumeShelveTestJSON-2055017111 None] Lock "cinder-f4a10fb8-a9f9-4153-9069-18993b0a52e4-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Flow 'volume_create_manager' (0dbf4015-ac68-41af-9261-31da2b630e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63826dc1-6961-4cbb-a955-e757fbc8180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63826dc1-6961-4cbb-a955-e757fbc8180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1600906119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047d9f69-4d5a-442a-8452-d47a1993edf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cede02d13e9c46ebb4ff46239fe9df18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:16:37Z,use_quota=True,user_id='8e82fddd8ea349dda01d17e76d7cbed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c9dbb8-b695-475b-9c61-d21b4e7729f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c9dbb8-b695-475b-9c61-d21b4e7729f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced7f7ff-e133-4b2a-926f-ee5c71b98f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced7f7ff-e133-4b2a-926f-ee5c71b98f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047d9f69-4d5a-442a-8452-d47a1993edf3', 'volume_name': 'volume-047d9f69-4d5a-442a-8452-d47a1993edf3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff971aa-e29d-4d51-9ed7-7880486df6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff971aa-e29d-4d51-9ed7-7880486df6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55117ad-423b-452f-b0a6-9b8bbd036cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:16:37 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Volume 047d9f69-4d5a-442a-8452-d47a1993edf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047d9f69-4d5a-442a-8452-d47a1993edf3', 'volume_size': 1} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1600906119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047d9f69-4d5a-442a-8452-d47a1993edf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cede02d13e9c46ebb4ff46239fe9df18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:16:37Z,use_quota=True,user_id='8e82fddd8ea349dda01d17e76d7cbed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Creating volume 047d9f69-4d5a-442a-8452-d47a1993edf3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:16:37 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:16:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:37 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 1073741824 Jul 21 17:16:37 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:38 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 1073741824" returned: 0 in 0.622s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:38 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 Jul 21 17:16:38 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:38 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3" returned: 0 in 0.411s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55117ad-423b-452f-b0a6-9b8bbd036cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047d9f69-4d5a-442a-8452-d47a1993edf3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b37316d-1751-4a15-8e92-8e22af273c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:16:38 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Volume volume-047d9f69-4d5a-442a-8452-d47a1993edf3 (047d9f69-4d5a-442a-8452-d47a1993edf3): created successfully Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b37316d-1751-4a15-8e92-8e22af273c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:16:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Flow 'volume_create_manager' (0dbf4015-ac68-41af-9261-31da2b630e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:16:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-acb68c59-df79-4389-b458-c024d31eaa8a tempest-ServerRescueNegativeTestJSON-915533584 None] Created volume successfully. Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:16:42 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:16:42 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:16:42 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.530s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 8 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:16:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:16:48 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:16:48 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:17:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Acquiring lock "cinder-047d9f69-4d5a-442a-8452-d47a1993edf3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "cinder-047d9f69-4d5a-442a-8452-d47a1993edf3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Acquiring lock "cinder-quobyte-047d9f69-4d5a-442a-8452-d47a1993edf3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "cinder-quobyte-047d9f69-4d5a-442a-8452-d47a1993edf3" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:02 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2034fad-292d-49f1-a897-459bc93be818]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:02 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 Jul 21 17:17:02 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:03 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3" returned: 0 in 0.711s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:03 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3 Jul 21 17:17:03 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:03 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-047d9f69-4d5a-442a-8452-d47a1993edf3" returned: 0 in 0.627s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "cinder-quobyte-047d9f69-4d5a-442a-8452-d47a1993edf3" released by "delete_volume" :: held 1.414s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:03 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Created reservations ['06eb2688-05a2-4618-a9cf-f00bfb73b1da', 'e71c4bdf-b019-4556-9f3d-9e54e3376a82', '4bd6d6b1-d164-47f9-a8a1-8ddd53c9f1e8', '2bbe908f-b0a5-4cfa-b432-ef255257d8fd'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:04 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:17:04 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:04 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.433s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:17:04 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Deleted volume successfully. Jul 21 17:17:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b6a889e8-4f83-4e3c-937b-eeaf1e8ea415 tempest-ServerRescueNegativeTestJSON-915533584 None] Lock "cinder-047d9f69-4d5a-442a-8452-d47a1993edf3-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Flow 'volume_create_manager' (a47c32aa-cf1d-4898-96df-372334bd7c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931a2a87-8a77-4f15-a2b2-7f1168a333a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931a2a87-8a77-4f15-a2b2-7f1168a333a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-859034029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef64528a-730e-47f9-bef6-9fffb2aa8bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0347904bf4accaeda15cc0d20f72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:13Z,use_quota=True,user_id='432b5cc738ca4a5aadc5961fee5e0761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ac56b2-3f4f-46b2-b4e9-62b1b5cf5c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ac56b2-3f4f-46b2-b4e9-62b1b5cf5c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3699390b-b82f-4f67-9472-704e96b519ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3699390b-b82f-4f67-9472-704e96b519ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef64528a-730e-47f9-bef6-9fffb2aa8bc9', 'volume_name': 'volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4cc9ff-85ce-469b-a6ed-b7e09403a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4cc9ff-85ce-469b-a6ed-b7e09403a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce91b8d-ec10-4502-8b3d-4b3db32f38a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Volume ef64528a-730e-47f9-bef6-9fffb2aa8bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9', 'volume_size': 1} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-859034029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef64528a-730e-47f9-bef6-9fffb2aa8bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0347904bf4accaeda15cc0d20f72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:13Z,use_quota=True,user_id='432b5cc738ca4a5aadc5961fee5e0761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Creating volume ef64528a-730e-47f9-bef6-9fffb2aa8bc9 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:12 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:12 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 1073741824 Jul 21 17:17:12 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:13 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 1073741824" returned: 0 in 0.862s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:13 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 Jul 21 17:17:13 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:14 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9" returned: 0 in 0.544s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce91b8d-ec10-4502-8b3d-4b3db32f38a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3533d6-5228-474a-b58d-500527bd8968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Volume volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 (ef64528a-730e-47f9-bef6-9fffb2aa8bc9): created successfully Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3533d6-5228-474a-b58d-500527bd8968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Flow 'volume_create_manager' (a47c32aa-cf1d-4898-96df-372334bd7c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b384659a-f10b-44be-a095-3ea20ab774e2 tempest-AttachVolumeTestJSON-1186318522 None] Created volume successfully. Jul 21 17:17:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-60dd7034-1b97-49eb-9152-f7429bc3d8bc req-8fd6aefb-4efa-454b-b001-b90af8743889 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-60dd7034-1b97-49eb-9152-f7429bc3d8bc req-8fd6aefb-4efa-454b-b001-b90af8743889 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-60dd7034-1b97-49eb-9152-f7429bc3d8bc req-8fd6aefb-4efa-454b-b001-b90af8743889 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-60dd7034-1b97-49eb-9152-f7429bc3d8bc req-8fd6aefb-4efa-454b-b001-b90af8743889 tempest-AttachVolumeTestJSON-1186318522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43ea6a75-abdf-4e37-ae34-c2a1dabecad9', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:17:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-60dd7034-1b97-49eb-9152-f7429bc3d8bc req-8fd6aefb-4efa-454b-b001-b90af8743889 tempest-AttachVolumeTestJSON-1186318522 None] attachment_update completed successfully. Jul 21 17:17:26 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:17:26 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=10,cinder:SELECT=16,cinder:INSERT=3 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Flow 'volume_create_manager' (dc9e90c0-db3b-499f-aa88-eb338c2baa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e600e77f-cfd6-46d9-b974-21f55749c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e600e77f-cfd6-46d9-b974-21f55749c62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1960174229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7457b772-b17d-4ae2-937c-dff7582c8a1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd33675d0ed24455a0d1c5ff0b5ab19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:30Z,use_quota=True,user_id='b5f9d573e69f41efabd684196f1095d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c61e3d4-d817-4d0f-8f5c-f2570e22c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c61e3d4-d817-4d0f-8f5c-f2570e22c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623885e3-c713-4eb7-a6da-fe91f4d570a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623885e3-c713-4eb7-a6da-fe91f4d570a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7457b772-b17d-4ae2-937c-dff7582c8a1b', 'volume_name': 'volume-7457b772-b17d-4ae2-937c-dff7582c8a1b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834a9045-4807-42a6-9619-7cfec550db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834a9045-4807-42a6-9619-7cfec550db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e461d0ee-fdc7-4f32-ab73-5e3549be7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Volume 7457b772-b17d-4ae2-937c-dff7582c8a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7457b772-b17d-4ae2-937c-dff7582c8a1b', 'volume_size': 1} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1960174229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7457b772-b17d-4ae2-937c-dff7582c8a1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd33675d0ed24455a0d1c5ff0b5ab19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:30Z,use_quota=True,user_id='b5f9d573e69f41efabd684196f1095d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Creating volume 7457b772-b17d-4ae2-937c-dff7582c8a1b {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:30 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:30 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b 1073741824 Jul 21 17:17:30 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:30 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b 1073741824" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:30 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b Jul 21 17:17:30 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:31 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b" returned: 0 in 0.290s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e461d0ee-fdc7-4f32-ab73-5e3549be7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7457b772-b17d-4ae2-937c-dff7582c8a1b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c1e8b8-73e8-41c0-9905-317d74ced332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:31 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Volume volume-7457b772-b17d-4ae2-937c-dff7582c8a1b (7457b772-b17d-4ae2-937c-dff7582c8a1b): created successfully Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c1e8b8-73e8-41c0-9905-317d74ced332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Flow 'volume_create_manager' (dc9e90c0-db3b-499f-aa88-eb338c2baa63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-aee3d620-3e6d-4e4f-be16-13c8515fddcc tempest-VolumesTestJSON-608454095 None] Created volume successfully. Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Flow 'volume_create_manager' (aba934ef-fbbb-4ee2-816f-524d0ad57260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2117e090-bdfa-4cd4-8a68-c854d9dd30a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Flow 'volume_create_manager' (3bf905af-2a56-4789-aebe-095bdae4b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5722668-abcf-4e99-9091-0543917f2225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2117e090-bdfa-4cd4-8a68-c854d9dd30a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-252666093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca21056d-04a4-49e4-9472-0ddc4844d689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4130fc11d6484f1b9eb7864805614c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:32Z,use_quota=True,user_id='b8930735732a44b798992f781e729956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282efc8a-d60f-4a12-bc27-42907fa1d093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282efc8a-d60f-4a12-bc27-42907fa1d093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5047f324-1c83-4217-b0b9-89b84d772bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5047f324-1c83-4217-b0b9-89b84d772bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca21056d-04a4-49e4-9472-0ddc4844d689', 'volume_name': 'volume-ca21056d-04a4-49e4-9472-0ddc4844d689', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff471583-96eb-4d21-bf55-2f0269faad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff471583-96eb-4d21-bf55-2f0269faad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a47bd0-594c-4493-a787-251f3a0451f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Volume ca21056d-04a4-49e4-9472-0ddc4844d689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca21056d-04a4-49e4-9472-0ddc4844d689', 'volume_size': 1} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-252666093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca21056d-04a4-49e4-9472-0ddc4844d689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4130fc11d6484f1b9eb7864805614c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:32Z,use_quota=True,user_id='b8930735732a44b798992f781e729956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Creating volume ca21056d-04a4-49e4-9472-0ddc4844d689 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:32 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5722668-abcf-4e99-9091-0543917f2225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1698618786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664c9064-e4b5-414c-a422-4ebea26210aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd33675d0ed24455a0d1c5ff0b5ab19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:32Z,use_quota=True,user_id='b5f9d573e69f41efabd684196f1095d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66863eca-7fd4-496b-b4c7-17294ffe5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 1073741824 Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66863eca-7fd4-496b-b4c7-17294ffe5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba3f5e2-b0af-40a0-85c9-8d54827e9c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba3f5e2-b0af-40a0-85c9-8d54827e9c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664c9064-e4b5-414c-a422-4ebea26210aa', 'volume_name': 'volume-664c9064-e4b5-414c-a422-4ebea26210aa', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca2df8c-a02c-4810-b521-50fb5be18549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca2df8c-a02c-4810-b521-50fb5be18549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f574c5ed-5ca9-47b3-b647-019df12c3b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:32 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Volume 664c9064-e4b5-414c-a422-4ebea26210aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664c9064-e4b5-414c-a422-4ebea26210aa', 'volume_size': 1} Jul 21 17:17:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:33 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 1073741824" returned: 0 in 0.948s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:33 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 Jul 21 17:17:33 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:33 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689" returned: 0 in 0.405s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1698618786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664c9064-e4b5-414c-a422-4ebea26210aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd33675d0ed24455a0d1c5ff0b5ab19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:32Z,use_quota=True,user_id='b5f9d573e69f41efabd684196f1095d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Creating volume 664c9064-e4b5-414c-a422-4ebea26210aa {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:33 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a47bd0-594c-4493-a787-251f3a0451f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca21056d-04a4-49e4-9472-0ddc4844d689', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:34 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa 1073741824 Jul 21 17:17:34 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019060cf-8384-4ac8-b6b6-f3e222d02191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:34 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Volume volume-ca21056d-04a4-49e4-9472-0ddc4844d689 (ca21056d-04a4-49e4-9472-0ddc4844d689): created successfully Jul 21 17:17:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019060cf-8384-4ac8-b6b6-f3e222d02191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Flow 'volume_create_manager' (aba934ef-fbbb-4ee2-816f-524d0ad57260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:34 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f2ace753-6a14-4e84-a15e-3a0f223588db tempest-ServerActionsTestOtherA-1333744704 None] Created volume successfully. Jul 21 17:17:34 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa 1073741824" returned: 0 in 0.785s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:34 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa Jul 21 17:17:34 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:35 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa" returned: 0 in 0.247s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f574c5ed-5ca9-47b3-b647-019df12c3b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664c9064-e4b5-414c-a422-4ebea26210aa', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c8e72-2d07-4378-8803-08261e6960ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Volume volume-664c9064-e4b5-414c-a422-4ebea26210aa (664c9064-e4b5-414c-a422-4ebea26210aa): created successfully Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c8e72-2d07-4378-8803-08261e6960ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Flow 'volume_create_manager' (3bf905af-2a56-4789-aebe-095bdae4b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:35 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-064534d4-b1c6-4ce7-87b8-0b626cd7fb9b tempest-VolumesTestJSON-608454095 None] Created volume successfully. Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Flow 'volume_create_manager' (22f98442-66fe-4555-91bf-ab004848c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4712963-35dc-4064-8e50-438b44e1ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4712963-35dc-4064-8e50-438b44e1ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1816432384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb89e91-3976-419b-8630-4c28495d62d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd33675d0ed24455a0d1c5ff0b5ab19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:36Z,use_quota=True,user_id='b5f9d573e69f41efabd684196f1095d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f5453b-e12a-4ec3-9fc4-8a41194de78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f5453b-e12a-4ec3-9fc4-8a41194de78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8691f0f2-7e15-4dad-b628-c55ce11b26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8691f0f2-7e15-4dad-b628-c55ce11b26c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb89e91-3976-419b-8630-4c28495d62d7', 'volume_name': 'volume-ccb89e91-3976-419b-8630-4c28495d62d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbf11e1-7d43-4c5e-a44a-172ba12257b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbf11e1-7d43-4c5e-a44a-172ba12257b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201d1ea1-5c8c-4250-aaf1-cc21bf54e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Volume ccb89e91-3976-419b-8630-4c28495d62d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb89e91-3976-419b-8630-4c28495d62d7', 'volume_size': 1} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1816432384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb89e91-3976-419b-8630-4c28495d62d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd33675d0ed24455a0d1c5ff0b5ab19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:36Z,use_quota=True,user_id='b5f9d573e69f41efabd684196f1095d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Creating volume ccb89e91-3976-419b-8630-4c28495d62d7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:36 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:36 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 1073741824 Jul 21 17:17:36 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:36 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 1073741824" returned: 0 in 0.493s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:36 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 Jul 21 17:17:36 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:37 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7" returned: 0 in 0.271s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201d1ea1-5c8c-4250-aaf1-cc21bf54e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb89e91-3976-419b-8630-4c28495d62d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5fb2a6-f2b4-4986-acd5-9c6e284cfe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:37 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Volume volume-ccb89e91-3976-419b-8630-4c28495d62d7 (ccb89e91-3976-419b-8630-4c28495d62d7): created successfully Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5fb2a6-f2b4-4986-acd5-9c6e284cfe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Flow 'volume_create_manager' (22f98442-66fe-4555-91bf-ab004848c451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d4e835da-f24f-4804-a54c-4d251e1af8c3 tempest-VolumesTestJSON-608454095 None] Created volume successfully. Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Acquiring lock "cinder-ccb89e91-3976-419b-8630-4c28495d62d7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Lock "cinder-ccb89e91-3976-419b-8630-4c28495d62d7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Acquiring lock "cinder-quobyte-ccb89e91-3976-419b-8630-4c28495d62d7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Lock "cinder-quobyte-ccb89e91-3976-419b-8630-4c28495d62d7" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a828a06a-8458-45e2-83d6-3026a1c8cfde]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:39 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 Jul 21 17:17:39 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:39 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7" returned: 0 in 0.431s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:39 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7 Jul 21 17:17:39 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:40 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ccb89e91-3976-419b-8630-4c28495d62d7" returned: 0 in 0.346s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Lock "cinder-quobyte-ccb89e91-3976-419b-8630-4c28495d62d7" released by "delete_volume" :: held 0.845s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Created reservations ['b0220507-ffbc-41d4-bc3d-89020cd745da', '12148024-d037-45cc-9889-9062d65e7a5c', 'ba3ea06a-f693-4e04-b862-ec9a15ef846c', 'e9448022-d619-4b94-b83a-e9aafffc7564'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:40 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:17:40 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Acquiring lock "cinder-664c9064-e4b5-414c-a422-4ebea26210aa-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Lock "cinder-664c9064-e4b5-414c-a422-4ebea26210aa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Acquiring lock "cinder-quobyte-664c9064-e4b5-414c-a422-4ebea26210aa" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Lock "cinder-quobyte-664c9064-e4b5-414c-a422-4ebea26210aa" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce253168-abb4-446e-bb99-da0a6a6498d3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:40 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.358s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:17:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Deleted volume successfully. Jul 21 17:17:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b5ba952-84d8-4098-b0bd-e991fff77ada tempest-VolumesTestJSON-608454095 None] Lock "cinder-ccb89e91-3976-419b-8630-4c28495d62d7-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:40 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa Jul 21 17:17:40 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:41 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa" returned: 0 in 0.839s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:41 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa Jul 21 17:17:41 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:42 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-664c9064-e4b5-414c-a422-4ebea26210aa" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Lock "cinder-quobyte-664c9064-e4b5-414c-a422-4ebea26210aa" released by "delete_volume" :: held 1.451s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:42 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:17:42 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Created reservations ['fe95c5f9-cab9-40cd-aeb9-d47cc0abbeb5', 'f21a4bf0-2bf1-4f4b-89a0-b12cc997df87', 'e6ab755a-223a-4a22-a767-4d76df5cd938', '7ff167a9-50f8-42b0-bb74-411479354120'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:42 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:17:42 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:42 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.327s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 8 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:17:42 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.354s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:17:42 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Deleted volume successfully. Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cd977431-32a7-46ef-ac65-f3847d391e22 tempest-VolumesTestJSON-608454095 None] Lock "cinder-664c9064-e4b5-414c-a422-4ebea26210aa-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Acquiring lock "cinder-7457b772-b17d-4ae2-937c-dff7582c8a1b-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Lock "cinder-7457b772-b17d-4ae2-937c-dff7582c8a1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Acquiring lock "cinder-quobyte-7457b772-b17d-4ae2-937c-dff7582c8a1b" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Lock "cinder-quobyte-7457b772-b17d-4ae2-937c-dff7582c8a1b" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e651f66-1b04-4156-8941-d20b01d28241]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:43 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b Jul 21 17:17:43 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:43 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b" returned: 0 in 0.378s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:43 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b Jul 21 17:17:43 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:43 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7457b772-b17d-4ae2-937c-dff7582c8a1b" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Lock "cinder-quobyte-7457b772-b17d-4ae2-937c-dff7582c8a1b" released by "delete_volume" :: held 0.689s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Created reservations ['f1ef8b42-4948-40b7-ad7a-c815cfc2c0b3', 'bad38119-52df-4aff-aacb-0788173c818e', '3cc77b7b-1b85-484d-bf6d-d826c11cd07d', 'de7eb4a2-8bec-4349-9ff8-a9150a72e9ea'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:44 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:17:44 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:44 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:44 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:17:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Deleted volume successfully. Jul 21 17:17:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49384c5e-566b-46b0-8b28-7a1c189c708a tempest-VolumesTestJSON-608454095 None] Lock "cinder-7457b772-b17d-4ae2-937c-dff7582c8a1b-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Flow 'volume_create_manager' (eafd696b-a3b6-4e4e-bc40-6c03fb407616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fd5ebe-4bd6-4b59-b8be-bb14aeb744fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fd5ebe-4bd6-4b59-b8be-bb14aeb744fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1362903952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11ec965-2868-4e04-86e3-17647fa8cb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdecc015f97d45dd9e034792d4e56174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:48Z,use_quota=True,user_id='767017f4ba5a4cbfabc52afe5275499f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdf051e-3e21-415d-b987-ce19338afb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdf051e-3e21-415d-b987-ce19338afb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edcd4be-e946-4afe-8a88-44cb4190959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edcd4be-e946-4afe-8a88-44cb4190959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11ec965-2868-4e04-86e3-17647fa8cb04', 'volume_name': 'volume-e11ec965-2868-4e04-86e3-17647fa8cb04', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8bc983-b8f4-41ba-bc0d-982d429ba55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8bc983-b8f4-41ba-bc0d-982d429ba55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816ef309-4c5a-4397-b38c-778f1bc45a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Volume e11ec965-2868-4e04-86e3-17647fa8cb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11ec965-2868-4e04-86e3-17647fa8cb04', 'volume_size': 1} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1362903952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11ec965-2868-4e04-86e3-17647fa8cb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdecc015f97d45dd9e034792d4e56174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:48Z,use_quota=True,user_id='767017f4ba5a4cbfabc52afe5275499f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Creating volume e11ec965-2868-4e04-86e3-17647fa8cb04 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:48 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:48 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 1073741824 Jul 21 17:17:48 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:48 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 1073741824" returned: 0 in 0.512s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:49 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 Jul 21 17:17:49 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:49 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04" returned: 0 in 0.324s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816ef309-4c5a-4397-b38c-778f1bc45a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11ec965-2868-4e04-86e3-17647fa8cb04', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d8423c-8f2d-4968-9a2a-f1e1ecf43087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:49 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Volume volume-e11ec965-2868-4e04-86e3-17647fa8cb04 (e11ec965-2868-4e04-86e3-17647fa8cb04): created successfully Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d8423c-8f2d-4968-9a2a-f1e1ecf43087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Flow 'volume_create_manager' (eafd696b-a3b6-4e4e-bc40-6c03fb407616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9af07996-0cb9-43b8-80ea-b3adaf85c73a tempest-AttachVolumeNegativeTest-1288094069 None] Created volume successfully. Jul 21 17:17:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-bf688aa3-e16d-4476-9748-75af05a44ab7 req-340f1a55-d0d3-44e1-885e-ceab7b83b5d9 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-bf688aa3-e16d-4476-9748-75af05a44ab7 req-340f1a55-d0d3-44e1-885e-ceab7b83b5d9 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-bf688aa3-e16d-4476-9748-75af05a44ab7 req-340f1a55-d0d3-44e1-885e-ceab7b83b5d9 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-bf688aa3-e16d-4476-9748-75af05a44ab7 req-340f1a55-d0d3-44e1-885e-ceab7b83b5d9 tempest-AttachVolumeNegativeTest-1288094069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-e11ec965-2868-4e04-86e3-17647fa8cb04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1da41709-0381-4ce1-9844-429758b51bfc', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:17:51 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-bf688aa3-e16d-4476-9748-75af05a44ab7 req-340f1a55-d0d3-44e1-885e-ceab7b83b5d9 tempest-AttachVolumeNegativeTest-1288094069 None] attachment_update completed successfully. Jul 21 17:17:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1996a78c-5fba-4b9d-a48a-c65a78f10665 tempest-GroupsV314Test-1899649170 None] Group tempest-GroupsV314Test-Group-1697620334: creating Jul 21 17:17:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1996a78c-5fba-4b9d-a48a-c65a78f10665 tempest-GroupsV314Test-1899649170 None] Group tempest-GroupsV314Test-Group-1697620334: created successfully Jul 21 17:17:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1996a78c-5fba-4b9d-a48a-c65a78f10665 tempest-GroupsV314Test-1899649170 None] Create group completed successfully. Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Flow 'volume_create_manager' (02808126-a0c4-4e48-bed9-f5ff1272f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d200065-2b47-48b5-9a33-cf5117c6a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d200065-2b47-48b5-9a33-cf5117c6a164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571953823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e522885c-5f8c-4d0d-8bc1-997776834886,host='devstack@QuobyteHD#QuobyteHD',id=bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5282d78ddbc74ab9a0ca6e18411459df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:55Z,use_quota=True,user_id='9eccae5294684970a0cbaf2489449534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(910a05f7-8833-4e55-80c5-a9f91e908853),volume_type_id=910a05f7-8833-4e55-80c5-a9f91e908853)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e89216a-ff4c-4cc8-9a13-25767356438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e89216a-ff4c-4cc8-9a13-25767356438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7254c899-4116-42fd-9be5-2b15ff9d0684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7254c899-4116-42fd-9be5-2b15ff9d0684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e', 'volume_name': 'volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a605f0-d415-4dcc-9756-4b2749c9fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a605f0-d415-4dcc-9756-4b2749c9fc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f54ff-c8ee-417f-a25d-69b16fca4393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Volume bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e', 'volume_size': 1} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e522885c-5f8c-4d0d-8bc1-997776834886,created_at=2026-07-21T15:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571953823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e522885c-5f8c-4d0d-8bc1-997776834886,host='devstack@QuobyteHD#QuobyteHD',id=bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5282d78ddbc74ab9a0ca6e18411459df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:17:55Z,use_quota=True,user_id='9eccae5294684970a0cbaf2489449534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(910a05f7-8833-4e55-80c5-a9f91e908853),volume_type_id=910a05f7-8833-4e55-80c5-a9f91e908853)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Creating volume bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:17:54 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:17:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:55 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e 1073741824 Jul 21 17:17:55 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:55 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e 1073741824" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:55 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:17:55 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:55 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f54ff-c8ee-417f-a25d-69b16fca4393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e093a30-ffe8-4259-97be-9af3c7bbe532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:17:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Volume volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e (bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e): created successfully Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e093a30-ffe8-4259-97be-9af3c7bbe532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:17:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Flow 'volume_create_manager' (02808126-a0c4-4e48-bed9-f5ff1272f304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:17:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c728212e-53a9-4103-9f0c-8e599f0b7e80 tempest-GroupsV314Test-1899649170 None] Created volume successfully. Jul 21 17:17:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:56 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Cloning volume bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e to volume 5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 Jul 21 17:17:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Creating offline snapshot 92c49de6-e65e-474b-89ed-6442a6383911 of volume bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:17:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b006be-a882-4c28-9a82-f33c3dea70d0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:57 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:17:57 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:57 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 0.546s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:57 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 1G Jul 21 17:17:57 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:58 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 1G" returned: 0 in 0.599s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:58 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 Jul 21 17:17:58 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:58 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:58 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:17:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:58 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 Jul 21 17:17:58 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:58 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:58 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info Jul 21 17:17:58 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:59 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info" returned: 0 in 0.308s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:59 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:59 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info Jul 21 17:17:59 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:59 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.info" returned: 0 in 0.247s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Acquiring lock "cinder-quobyte-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] snapshot: 92c49de6-e65e-474b-89ed-6442a6383911, volume: 5f5e3190-0129-4af4-8d07-6cc6d9aa13a0, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f02e08-6da2-436c-a859-8ae4c1f8c495]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:17:59 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 Jul 21 17:17:59 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:17:59 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911" returned: 0 in 0.556s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d6c83a-500f-4957-9173-4d2ea88ab453]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:17:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:00 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:18:00 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:00 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 0.530s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:00 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:18:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:00 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 Jul 21 17:18:00 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:05 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-ed5475d6-01fe-431b-9725-69e03b4241ba req-f25b81c2-b3fa-4107-ad5c-009110682587 tempest-AttachVolumeTestJSON-1186318522 None] Terminate volume connection completed successfully. Jul 21 17:18:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-ed5475d6-01fe-431b-9725-69e03b4241ba req-f25b81c2-b3fa-4107-ad5c-009110682587 tempest-AttachVolumeTestJSON-1186318522 None] Deleting attachment 43ea6a75-abdf-4e37-ae34-c2a1dabecad9. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:18:07 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" returned: 0 in 7.368s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:07 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65e8679-9f2c-4021-bbf4-a50f324647bf]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:08 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:18:08 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:08 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=40,cinder:UPDATE=55,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:18:09 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 1.120s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:18:09 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Converted 1024.00 MB image at 138.95 MB/s Jul 21 17:18:09 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:09 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 Jul 21 17:18:09 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:09 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" returned: 0 in 0.377s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" released by "_copy_volume_from_snapshot" :: held 10.085s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Acquiring lock "cinder-quobyte-92c49de6-e65e-474b-89ed-6442a6383911" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-92c49de6-e65e-474b-89ed-6442a6383911" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Deleting offline snapshot 92c49de6-e65e-474b-89ed-6442a6383911 of volume bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] snapshot_file for this snap is: volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2752c6-424d-4e67-b790-d0d3c42ef55d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:09 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 Jul 21 17:18:09 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:10 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911" returned: 0 in 0.531s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a01adb9-4901-4b00-8ba0-a29243a49cb7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-d4821e06-eb16-4929-a6d9-e9dd4cf5c254 req-58d6cada-8a45-4cf5-9c6b-15ff76f1b41b tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:10 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:18:10 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:10 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 0.479s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:10 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 Jul 21 17:18:10 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:10 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911" returned: 0 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:10 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911 Jul 21 17:18:10 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:11 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e.92c49de6-e65e-474b-89ed-6442a6383911" returned: 0 in 0.395s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-92c49de6-e65e-474b-89ed-6442a6383911" released by "_delete_snapshot" :: held 1.953s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.606s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-d4821e06-eb16-4929-a6d9-e9dd4cf5c254 req-58d6cada-8a45-4cf5-9c6b-15ff76f1b41b tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.352s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-d4821e06-eb16-4929-a6d9-e9dd4cf5c254 req-58d6cada-8a45-4cf5-9c6b-15ff76f1b41b tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-d4821e06-eb16-4929-a6d9-e9dd4cf5c254 req-58d6cada-8a45-4cf5-9c6b-15ff76f1b41b tempest-ServerActionsTestOtherA-1333744704 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-ca21056d-04a4-49e4-9472-0ddc4844d689', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed26c10b-5dfa-4cb9-a203-ea9a16dde5e9', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:18:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ce4fbdb9-7bda-44f9-a2bc-d5e3ff884dca tempest-GroupsV314Test-1899649170 None] Create group from source-group-e522885c-5f8c-4d0d-8bc1-997776834886 completed successfully. Jul 21 17:18:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-d4821e06-eb16-4929-a6d9-e9dd4cf5c254 req-58d6cada-8a45-4cf5-9c6b-15ff76f1b41b tempest-ServerActionsTestOtherA-1333744704 None] attachment_update completed successfully. Jul 21 17:18:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Acquiring lock "cinder-quobyte-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" acquired by "delete_volume" :: waited 0.055s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b74333-7ae5-47bc-b1a9-f3294c0dc606]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:14 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 Jul 21 17:18:14 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:14 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" returned: 0 in 0.751s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:14 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0 Jul 21 17:18:14 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:15 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" returned: 0 in 0.373s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-5f5e3190-0129-4af4-8d07-6cc6d9aa13a0" released by "delete_volume" :: held 1.203s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Created reservations ['a71e8f38-f644-4ac4-a42f-1ca072248f42'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:15 devstack cinder-volume[87591]: WARNING cinder.quota [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1127208099 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1127208099, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:18:15 devstack cinder-volume[87591]: WARNING cinder.quota [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1127208099 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1127208099, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Created reservations ['cca7eb62-3033-4e5e-9c2d-d681e8595751', '715d56f0-5886-41ae-8ec4-d076a05345c2', 'fb311c70-0582-46fb-9367-ef134febc011', 'a0f7d60f-04c5-4da9-b439-c4f0ba0ebf47'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:15 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:18:15 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:15 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.265s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:15 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:18:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-95ed50cd-33af-4dce-b28a-4e8764e29dfd tempest-GroupsV314Test-1899649170 None] Delete group completed successfully. Jul 21 17:18:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-740dc23a-8cc6-40a8-8a1e-b965fc8245d4 tempest-ServerActionsTestOtherA-1333744704 None] Terminate volume connection completed successfully. Jul 21 17:18:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-740dc23a-8cc6-40a8-8a1e-b965fc8245d4 tempest-ServerActionsTestOtherA-1333744704 None] Deleting attachment ed26c10b-5dfa-4cb9-a203-ea9a16dde5e9. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Acquiring lock "cinder-quobyte-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ba887-a653-4a3a-8c8b-3d351b8bb5be]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-d3cecc64-d8d3-4427-a1fc-de8bcd6b31b0 tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-d3cecc64-d8d3-4427-a1fc-de8bcd6b31b0 tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:17 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:18:17 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-d3cecc64-d8d3-4427-a1fc-de8bcd6b31b0 tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-d3cecc64-d8d3-4427-a1fc-de8bcd6b31b0 tempest-ServerActionsTestOtherA-1333744704 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-ca21056d-04a4-49e4-9472-0ddc4844d689', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08e274d0-55e5-4de5-9f45-8d757df44fed', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:18:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-f1a0b1f9-ec14-4647-ba1f-1fffda95176f req-d3cecc64-d8d3-4427-a1fc-de8bcd6b31b0 tempest-ServerActionsTestOtherA-1333744704 None] attachment_update completed successfully. Jul 21 17:18:17 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 0.486s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:17 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e Jul 21 17:18:17 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:18 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" returned: 0 in 0.276s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Lock "cinder-quobyte-bb15d5ff-62b6-4deb-a5d6-7b5c2b08bb3e" released by "delete_volume" :: held 0.865s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Created reservations ['0f327805-6f83-40b7-a851-ac8c1a8009d3'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Created reservations ['9159d436-ae95-45a1-85da-ef281716d695', '6fcbf34b-9e58-450a-905f-429ae2b645d6', '35939fa1-9017-4971-a61a-c24e3767542e', '25419ab1-a1e3-4086-b8f6-8d303f55db47'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:18 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:18:18 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:18 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.297s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:18 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:18:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-95e96b82-7a83-408c-b5cf-4c6d35905fdf tempest-GroupsV314Test-1899649170 None] Delete group completed successfully. Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Flow 'volume_create_manager' (092a9e4c-5913-4d01-9c04-6dc5155d83ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644b8d2a-c7fb-4e7f-b2f0-0408462896a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644b8d2a-c7fb-4e7f-b2f0-0408462896a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-790522500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392dba36-70a3-4edb-b3c3-e43324dc56ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05863864d7e84a50b2c7758a2ea0f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:18:26Z,use_quota=True,user_id='61dd0ff5ae66425ca0c46233340af402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d855043-7bf7-48cb-847b-605451d9dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d855043-7bf7-48cb-847b-605451d9dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b6324e-5222-4973-aa0e-37e74cb382e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b6324e-5222-4973-aa0e-37e74cb382e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392dba36-70a3-4edb-b3c3-e43324dc56ab', 'volume_name': 'volume-392dba36-70a3-4edb-b3c3-e43324dc56ab', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787550e3-2fe5-43f0-9103-d563059e93ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787550e3-2fe5-43f0-9103-d563059e93ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a4a45e-c35c-4e2c-a163-f002e804576e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:18:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Volume 392dba36-70a3-4edb-b3c3-e43324dc56ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392dba36-70a3-4edb-b3c3-e43324dc56ab', 'volume_size': 1} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-790522500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392dba36-70a3-4edb-b3c3-e43324dc56ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05863864d7e84a50b2c7758a2ea0f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:18:26Z,use_quota=True,user_id='61dd0ff5ae66425ca0c46233340af402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Creating volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:18:25 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:18:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:25 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab 1073741824 Jul 21 17:18:25 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:26 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab 1073741824" returned: 0 in 0.414s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:26 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab Jul 21 17:18:26 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:26 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab" returned: 0 in 0.248s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a4a45e-c35c-4e2c-a163-f002e804576e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392dba36-70a3-4edb-b3c3-e43324dc56ab', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3b2a10-d80f-43c7-950b-0fc78c881a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:18:26 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Volume volume-392dba36-70a3-4edb-b3c3-e43324dc56ab (392dba36-70a3-4edb-b3c3-e43324dc56ab): created successfully Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3b2a10-d80f-43c7-950b-0fc78c881a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Flow 'volume_create_manager' (092a9e4c-5913-4d01-9c04-6dc5155d83ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:18:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9a226b8e-df26-4e00-b447-b5c75d2bf09d tempest-SnapshotsActionsTest-2037111662 None] Created volume successfully. Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=80,cinder:INSERT=14,cinder:UPDATE=68,cinder:DELETE=7 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Creating offline snapshot fe879998-2c77-4d95-9e07-75b541f7e78e of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a3e01d-cce5-4048-b58b-2f0b946f13c7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:27 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab Jul 21 17:18:27 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:27 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:27 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e 1G Jul 21 17:18:27 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:27 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e 1G" returned: 0 in 0.394s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:27 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:27 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:28 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:28 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e is being set with open permissions: ugo+rw Jul 21 17:18:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:28 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:28 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:28 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.247s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:28 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info Jul 21 17:18:28 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:28 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:28 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info is being set with open permissions: ugo+rw Jul 21 17:18:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:28 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info Jul 21 17:18:28 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:29 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.info" returned: 0 in 0.397s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4f7cbfc5-1423-48c6-8e66-a5438a18574b tempest-SnapshotsActionsTest-2037111662 None] Create snapshot completed successfully Jul 21 17:18:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Creating offline snapshot 0cfc7086-28d8-4232-8525-d3cc87ec14cb of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:18:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ab451-2273-4667-85e5-71dcafd1b86d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:30 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:30 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:31 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.414s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:31 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb 1G Jul 21 17:18:31 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:31 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb 1G" returned: 0 in 0.522s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:31 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb Jul 21 17:18:31 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:32 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb" returned: 0 in 0.374s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:32 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb is being set with open permissions: ugo+rw Jul 21 17:18:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:32 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb Jul 21 17:18:32 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:32 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb" returned: 0 in 0.271s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.706s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3750c2d4-e8c3-4b24-bd7f-37e091267396 tempest-SnapshotsActionsTest-2037111662 None] Create snapshot completed successfully Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-0cfc7086-28d8-4232-8525-d3cc87ec14cb-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-0cfc7086-28d8-4232-8525-d3cc87ec14cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-0cfc7086-28d8-4232-8525-d3cc87ec14cb" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-0cfc7086-28d8-4232-8525-d3cc87ec14cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Deleting offline snapshot 0cfc7086-28d8-4232-8525-d3cc87ec14cb of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] snapshot_file for this snap is: volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[35862d6e-afa5-4fe1-b75c-a4f2f5cab277]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-7b04dff7-92c4-44b2-a1e9-add9e13328ea req-365ac46c-c8a6-4d97-a638-fca1126f8698 tempest-AttachVolumeNegativeTest-1288094069 None] Terminate volume connection completed successfully. Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-7b04dff7-92c4-44b2-a1e9-add9e13328ea req-365ac46c-c8a6-4d97-a638-fca1126f8698 tempest-AttachVolumeNegativeTest-1288094069 None] Deleting attachment 1da41709-0381-4ce1-9844-429758b51bfc. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:18:33 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb Jul 21 17:18:33 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:33 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb" returned: 0 in 0.381s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9634f7-0bf7-4b28-9f96-d4e14796ef69]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:33 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:33 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:33 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.453s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:34 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb Jul 21 17:18:34 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:34 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb" returned: 0 in 0.700s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:34 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb Jul 21 17:18:34 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:35 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.0cfc7086-28d8-4232-8525-d3cc87ec14cb" returned: 0 in 0.577s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-0cfc7086-28d8-4232-8525-d3cc87ec14cb" released by "_delete_snapshot" :: held 2.255s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" released by "delete_snapshot" :: held 2.288s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:35 devstack cinder-volume[87591]: WARNING cinder.quota [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:18:35 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Created reservations ['406a94ca-0841-4794-9b23-b28f17d3e3cc', '0b5199ed-a1e4-4595-a705-f904b6a01519', 'f58bab85-4d5e-4d1f-b826-2678a221a37c', '5cbb19a6-322b-4cec-9cc5-14285ade69fc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:35 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Delete snapshot completed successfully. Jul 21 17:18:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f78a8801-136a-4c50-89d0-0e56a0e610e1 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-0cfc7086-28d8-4232-8525-d3cc87ec14cb-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Creating offline snapshot 5e63f35c-2096-48f8-9a87-751bd107b424 of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:18:36 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae92ef-1971-4d2a-b0a0-d14d285af430]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:36 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:36 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:37 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.373s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:37 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 1G Jul 21 17:18:37 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:37 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 1G" returned: 0 in 0.463s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:37 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 Jul 21 17:18:37 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:37 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:37 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 is being set with open permissions: ugo+rw Jul 21 17:18:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:37 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 Jul 21 17:18:37 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:38 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424" returned: 0 in 0.265s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.547s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a2310a64-074f-4a1b-bfb7-c980f7c56311 tempest-SnapshotsActionsTest-2037111662 None] Create snapshot completed successfully Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-5e63f35c-2096-48f8-9a87-751bd107b424-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-5e63f35c-2096-48f8-9a87-751bd107b424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-5e63f35c-2096-48f8-9a87-751bd107b424" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-5e63f35c-2096-48f8-9a87-751bd107b424" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Deleting offline snapshot 5e63f35c-2096-48f8-9a87-751bd107b424 of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] snapshot_file for this snap is: volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0090c7-1927-4b8b-9489-0058cf350445]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:39 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 Jul 21 17:18:39 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:39 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424" returned: 0 in 0.452s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ca3b8-3d54-4f78-8728-7585a520ffdc]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:39 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:39 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:39 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.430s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:40 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 Jul 21 17:18:40 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:40 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424" returned: 0 in 0.504s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:40 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424 Jul 21 17:18:40 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:40 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.5e63f35c-2096-48f8-9a87-751bd107b424" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-5e63f35c-2096-48f8-9a87-751bd107b424" released by "_delete_snapshot" :: held 1.838s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" released by "delete_snapshot" :: held 1.877s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Created reservations ['3d2f2011-65e8-403a-aae5-90a8f012bd6c', '916e5b05-9d87-4653-a396-1d2034a624ac', 'd99686d2-8fff-4a32-a010-220e21abe2be', '677a4f7d-7edc-41af-a04c-35913306ff74'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Delete snapshot completed successfully. Jul 21 17:18:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eb2fe486-7d7e-4c26-956a-405e263617aa tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-5e63f35c-2096-48f8-9a87-751bd107b424-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Creating offline snapshot 194e286f-2c72-4d7f-b63f-bbbb58ed7f58 of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a18663-af66-4a45-b204-f2f2d341c6fc]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:41 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:41 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:41 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.393s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:41 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 1G Jul 21 17:18:41 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 8 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:18:42 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 1G" returned: 0 in 0.530s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:42 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 Jul 21 17:18:42 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:42 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:42 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 is being set with open permissions: ugo+rw Jul 21 17:18:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:42 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 Jul 21 17:18:42 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:43 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58" returned: 0 in 0.288s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.683s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b54640d6-bbe0-42bf-9211-bd77f669d102 tempest-SnapshotsActionsTest-2037111662 None] Create snapshot completed successfully Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-194e286f-2c72-4d7f-b63f-bbbb58ed7f58-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-194e286f-2c72-4d7f-b63f-bbbb58ed7f58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-194e286f-2c72-4d7f-b63f-bbbb58ed7f58" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-194e286f-2c72-4d7f-b63f-bbbb58ed7f58" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Deleting offline snapshot 194e286f-2c72-4d7f-b63f-bbbb58ed7f58 of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] snapshot_file for this snap is: volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[46553580-951a-4041-8242-36950259c5a6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:44 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 Jul 21 17:18:44 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:44 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58" returned: 0 in 0.627s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea280715-c81e-497e-b167-ae33eabb493b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:44 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:44 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:45 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.728s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:45 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 Jul 21 17:18:45 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:45 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58" returned: 0 in 0.535s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:45 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58 Jul 21 17:18:45 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:46 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.194e286f-2c72-4d7f-b63f-bbbb58ed7f58" returned: 0 in 0.294s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-194e286f-2c72-4d7f-b63f-bbbb58ed7f58" released by "_delete_snapshot" :: held 2.352s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" released by "delete_snapshot" :: held 2.392s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:46 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Created reservations ['d2c9e83a-9c1c-45f1-9d4c-329a0f711d00', '27921bee-8812-4b4c-9fca-570dfb0fd052', 'fd762d48-f52b-4901-916e-09e3c3da0362', '976bffd9-c3aa-43d9-b363-7118bec2e96c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Delete snapshot completed successfully. Jul 21 17:18:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b55c3351-8f0e-4c75-b5d7-e058ef1f9027 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-194e286f-2c72-4d7f-b63f-bbbb58ed7f58-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Creating offline snapshot a5238ea7-45cf-4fba-ba2b-4fb864f9c567 of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:18:47 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b307fb2-d4b1-4263-8c0b-56fa4c4562fb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:47 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:47 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:48 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.769s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:48 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 1G Jul 21 17:18:48 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:49 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 1G" returned: 0 in 0.875s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:49 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 Jul 21 17:18:49 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:49 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567" returned: 0 in 0.560s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:49 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 is being set with open permissions: ugo+rw Jul 21 17:18:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:49 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 Jul 21 17:18:49 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:50 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567" returned: 0 in 0.691s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:50 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-72ff4d5b-4311-445a-aca2-fce5486a38b3 tempest-SnapshotsActionsTest-2037111662 None] Create snapshot completed successfully Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-a5238ea7-45cf-4fba-ba2b-4fb864f9c567-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-a5238ea7-45cf-4fba-ba2b-4fb864f9c567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Acquiring lock "cinder-quobyte-a5238ea7-45cf-4fba-ba2b-4fb864f9c567" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-a5238ea7-45cf-4fba-ba2b-4fb864f9c567" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Deleting offline snapshot a5238ea7-45cf-4fba-ba2b-4fb864f9c567 of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:18:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] snapshot_file for this snap is: volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:18:51 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1cb312-f654-4296-8911-a18619b91d07]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:51 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 Jul 21 17:18:51 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:51 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:51 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489bcd8-c63d-4ca7-9a7a-915d4a5a2f38]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:51 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:51 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:52 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.602s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:52 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 Jul 21 17:18:52 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:52 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567" returned: 0 in 0.509s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:52 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567 Jul 21 17:18:52 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:53 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.a5238ea7-45cf-4fba-ba2b-4fb864f9c567" returned: 0 in 0.810s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-a5238ea7-45cf-4fba-ba2b-4fb864f9c567" released by "_delete_snapshot" :: held 2.569s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" released by "delete_snapshot" :: held 2.608s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:53 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Created reservations ['c37475e8-77ee-4867-9326-6fd280e7fa23', '71b44029-1261-4c81-9cef-532bac77da63', '3d1e3ff2-2c2b-40b4-b3ea-7b1fcbd63e8d', 'db88bb1f-937b-454a-b46b-0ecec83911c2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Delete snapshot completed successfully. Jul 21 17:18:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-77cf1d72-81a0-49d2-b0d7-0fb4ba159382 tempest-SnapshotsActionsTest-1268221447 None] Lock "cinder-a5238ea7-45cf-4fba-ba2b-4fb864f9c567-delete_snapshot" released by "delete_snapshot" :: held 2.860s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "cinder-fe879998-2c77-4d95-9e07-75b541f7e78e-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-fe879998-2c77-4d95-9e07-75b541f7e78e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "cinder-quobyte-fe879998-2c77-4d95-9e07-75b541f7e78e" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-quobyte-fe879998-2c77-4d95-9e07-75b541f7e78e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Deleting offline snapshot fe879998-2c77-4d95-9e07-75b541f7e78e of volume 392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] snapshot_file for this snap is: volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae4a7b7-ce31-415b-bd7f-b4cd777dd2e2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:55 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:55 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:55 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.687s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392dba36-70a3-4edb-b3c3-e43324dc56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:18:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cf6f72-8870-4385-9068-a8cf1360bc4c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:55 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab Jul 21 17:18:55 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:56 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:56 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:56 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:56 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.354s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:56 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e Jul 21 17:18:56 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:56 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab.fe879998-2c77-4d95-9e07-75b541f7e78e" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-quobyte-fe879998-2c77-4d95-9e07-75b541f7e78e" released by "_delete_snapshot" :: held 1.962s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" released by "delete_snapshot" :: held 2.008s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:56 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Created reservations ['40e1ee51-e5b2-4fd1-869e-f758e8da9cca', '63c704b4-b793-4319-a34f-c00e63fe0b11', '1c6e6d73-2a23-496d-83c0-c734a4a059e6', 'd1b1dc48-0b63-44e9-bbca-feda88f4952d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Delete snapshot completed successfully. Jul 21 17:18:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-291ade65-4863-44fd-af58-3296532a2961 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-fe879998-2c77-4d95-9e07-75b541f7e78e-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "cinder-392dba36-70a3-4edb-b3c3-e43324dc56ab-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-392dba36-70a3-4edb-b3c3-e43324dc56ab-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f201a-fe87-4121-9265-de0c078d98c0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:58 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab Jul 21 17:18:58 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:58 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:58 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab Jul 21 17:18:58 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:59 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-392dba36-70a3-4edb-b3c3-e43324dc56ab" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-quobyte-392dba36-70a3-4edb-b3c3-e43324dc56ab" released by "delete_volume" :: held 0.865s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Created reservations ['b0f81630-5885-448c-a91b-ff399d3ca791', 'c57b62ba-9fc2-45c1-84cc-dab8527cf3de', '7fe86b26-90d4-4ebb-89f6-cf5bebaa01ac', '7065620e-10e1-46a0-8375-1a29cd25bf8a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:18:59 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:18:59 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:18:59 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.334s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:18:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Deleted volume successfully. Jul 21 17:18:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fc3400a7-66c7-459e-adbd-1c82b10b7040 tempest-SnapshotsActionsTest-2037111662 None] Lock "cinder-392dba36-70a3-4edb-b3c3-e43324dc56ab-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-b4132cf8-5069-4959-8f52-84ff6048d591 req-471791b7-f12d-46c0-bf87-9d3ece5f7778 tempest-ServerActionsTestOtherA-1333744704 None] Terminate volume connection completed successfully. Jul 21 17:19:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-b4132cf8-5069-4959-8f52-84ff6048d591 req-471791b7-f12d-46c0-bf87-9d3ece5f7778 tempest-ServerActionsTestOtherA-1333744704 None] Deleting attachment 08e274d0-55e5-4de5-9f45-8d757df44fed. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:19:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "cinder-ca21056d-04a4-49e4-9472-0ddc4844d689-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Lock "cinder-ca21056d-04a4-49e4-9472-0ddc4844d689-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "cinder-quobyte-ca21056d-04a4-49e4-9472-0ddc4844d689" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Lock "cinder-quobyte-ca21056d-04a4-49e4-9472-0ddc4844d689" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:06 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08fc44e-2ed4-438d-a130-4c9a2f33ebe6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:19:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:06 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 Jul 21 17:19:06 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:07 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689" returned: 0 in 0.366s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:07 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689 Jul 21 17:19:07 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:07 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ca21056d-04a4-49e4-9472-0ddc4844d689" returned: 0 in 0.248s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Lock "cinder-quobyte-ca21056d-04a4-49e4-9472-0ddc4844d689" released by "delete_volume" :: held 0.670s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Created reservations ['2691871c-2e69-4b15-beb0-c2906f769163', '1ad64d86-3cbe-4ed0-91eb-b2ac0d453b3d', 'dddee7bb-b59a-4860-8055-a7600c7d4920', '91e3fec9-2586-49a8-84cd-9e1198bfe213'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:07 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:07 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:07 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.326s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:07 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Deleted volume successfully. Jul 21 17:19:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-60cf4d32-40cb-43b0-8375-537e1133595c tempest-ServerActionsTestOtherA-1333744704 None] Lock "cinder-ca21056d-04a4-49e4-9472-0ddc4844d689-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Flow 'volume_create_manager' (07cb2872-879a-45fc-9013-d86802c270f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc169536-be33-46a1-aa9f-5aca6675419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=79,cinder:SELECT=87,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc169536-be33-46a1-aa9f-5aca6675419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1760405405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ff005d-6317-4ef5-bfbf-f38d3f0f7924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdecc015f97d45dd9e034792d4e56174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:14Z,use_quota=True,user_id='767017f4ba5a4cbfabc52afe5275499f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caae28f-4609-46b7-9b69-5bf7f07fcbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caae28f-4609-46b7-9b69-5bf7f07fcbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae8c478-d349-4aee-9f5c-863ebfdac9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae8c478-d349-4aee-9f5c-863ebfdac9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ff005d-6317-4ef5-bfbf-f38d3f0f7924', 'volume_name': 'volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1c538d-0344-4bfe-b362-cab42aaa4196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1c538d-0344-4bfe-b362-cab42aaa4196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538d9359-ea16-4df0-aba8-da0a30baf93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Volume d4ff005d-6317-4ef5-bfbf-f38d3f0f7924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924', 'volume_size': 1} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1760405405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ff005d-6317-4ef5-bfbf-f38d3f0f7924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdecc015f97d45dd9e034792d4e56174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:14Z,use_quota=True,user_id='767017f4ba5a4cbfabc52afe5275499f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Creating volume d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:19:13 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:19:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:13 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 1073741824 Jul 21 17:19:13 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:14 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 1073741824" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:14 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 Jul 21 17:19:14 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:14 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924" returned: 0 in 0.300s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538d9359-ea16-4df0-aba8-da0a30baf93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daeca9f-62f1-489b-b6f6-0bf56f01ab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Volume volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 (d4ff005d-6317-4ef5-bfbf-f38d3f0f7924): created successfully Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daeca9f-62f1-489b-b6f6-0bf56f01ab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Flow 'volume_create_manager' (07cb2872-879a-45fc-9013-d86802c270f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8eebbb07-5be5-4753-8b3e-3b6192da8f6e tempest-AttachVolumeNegativeTest-1288094069 None] Created volume successfully. Jul 21 17:19:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-0a3b517c-47e9-42b7-a6a8-1aca4a2a24d0 req-4eaf5b25-bc22-4b53-9b98-8f1aa0805eac tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-0a3b517c-47e9-42b7-a6a8-1aca4a2a24d0 req-4eaf5b25-bc22-4b53-9b98-8f1aa0805eac tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-0a3b517c-47e9-42b7-a6a8-1aca4a2a24d0 req-4eaf5b25-bc22-4b53-9b98-8f1aa0805eac tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-0a3b517c-47e9-42b7-a6a8-1aca4a2a24d0 req-4eaf5b25-bc22-4b53-9b98-8f1aa0805eac tempest-AttachVolumeNegativeTest-1288094069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b4a45be-b58c-4fe2-a028-f52ed4c9e5ba', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:19:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-0a3b517c-47e9-42b7-a6a8-1aca4a2a24d0 req-4eaf5b25-bc22-4b53-9b98-8f1aa0805eac tempest-AttachVolumeNegativeTest-1288094069 None] attachment_update completed successfully. Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Flow 'volume_create_manager' (4d0050d4-55d0-4d6d-95bf-1bb021b01333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe8dc16-f453-435c-a2b6-a786ad16dba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe8dc16-f453-435c-a2b6-a786ad16dba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770759732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3efed1f-f986-4c8e-81a6-cc36e5b0a843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0347904bf4accaeda15cc0d20f72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:19Z,use_quota=True,user_id='432b5cc738ca4a5aadc5961fee5e0761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0398c1cd-2e00-40e2-9f4a-b3d5c26683e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0398c1cd-2e00-40e2-9f4a-b3d5c26683e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360373f6-a2fd-4567-a565-2a3bd6b220b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360373f6-a2fd-4567-a565-2a3bd6b220b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3efed1f-f986-4c8e-81a6-cc36e5b0a843', 'volume_name': 'volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50841c9-8b59-4bcf-8764-7f7a09594e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50841c9-8b59-4bcf-8764-7f7a09594e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6cecd3-389f-4b42-8b73-f9e5b578c963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Volume d3efed1f-f986-4c8e-81a6-cc36e5b0a843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843', 'volume_size': 1} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770759732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3efed1f-f986-4c8e-81a6-cc36e5b0a843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0347904bf4accaeda15cc0d20f72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:19Z,use_quota=True,user_id='432b5cc738ca4a5aadc5961fee5e0761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Creating volume d3efed1f-f986-4c8e-81a6-cc36e5b0a843 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:19:18 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:19:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:18 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 1073741824 Jul 21 17:19:18 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:19 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 1073741824" returned: 0 in 0.696s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:19 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 Jul 21 17:19:19 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-483d8559-eb58-4052-b5bf-7c5f18331c39 req-14aa5fc6-6008-42d0-b555-79f2ab929670 tempest-AttachVolumeNegativeTest-1288094069 None] Terminate volume connection completed successfully. Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-483d8559-eb58-4052-b5bf-7c5f18331c39 req-14aa5fc6-6008-42d0-b555-79f2ab929670 tempest-AttachVolumeNegativeTest-1288094069 None] Deleting attachment 0b4a45be-b58c-4fe2-a028-f52ed4c9e5ba. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:19:19 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843" returned: 0 in 0.350s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6cecd3-389f-4b42-8b73-f9e5b578c963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d8ec02-6484-448b-a1ac-7184ea3f6761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Volume volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 (d3efed1f-f986-4c8e-81a6-cc36e5b0a843): created successfully Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d8ec02-6484-448b-a1ac-7184ea3f6761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Flow 'volume_create_manager' (4d0050d4-55d0-4d6d-95bf-1bb021b01333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-61c31ecb-1e32-4cd2-9189-313369975758 tempest-AttachVolumeTestJSON-1186318522 None] Created volume successfully. Jul 21 17:19:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-95c3415b-7dd3-418d-994c-ad670684fd37 req-8e3b8706-a281-401d-8464-b1e8b33518f6 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-95c3415b-7dd3-418d-994c-ad670684fd37 req-8e3b8706-a281-401d-8464-b1e8b33518f6 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-95c3415b-7dd3-418d-994c-ad670684fd37 req-8e3b8706-a281-401d-8464-b1e8b33518f6 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-95c3415b-7dd3-418d-994c-ad670684fd37 req-8e3b8706-a281-401d-8464-b1e8b33518f6 tempest-AttachVolumeTestJSON-1186318522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0e76d96-8edf-4b1f-97ac-f089eb27030c', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:19:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-95c3415b-7dd3-418d-994c-ad670684fd37 req-8e3b8706-a281-401d-8464-b1e8b33518f6 tempest-AttachVolumeTestJSON-1186318522 None] attachment_update completed successfully. Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Flow 'volume_create_manager' (9b2e09cf-064a-41f9-9169-250a55e67fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69fd2c9c-db92-4391-bfb4-4ad55c0a9200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69fd2c9c-db92-4391-bfb4-4ad55c0a9200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-639018578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47de569-32fd-4d08-9186-faf06659aaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0347904bf4accaeda15cc0d20f72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:25Z,use_quota=True,user_id='432b5cc738ca4a5aadc5961fee5e0761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d3f3a4-f486-4183-a2db-bcb98ce6e05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d3f3a4-f486-4183-a2db-bcb98ce6e05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1a3128-02e1-42c6-b3c0-e69a528ae79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1a3128-02e1-42c6-b3c0-e69a528ae79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b47de569-32fd-4d08-9186-faf06659aaf0', 'volume_name': 'volume-b47de569-32fd-4d08-9186-faf06659aaf0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a8792-13a1-47ae-bc5d-af36f77c2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a8792-13a1-47ae-bc5d-af36f77c2319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d229711-e65a-4260-8048-7e17a35a9ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Volume b47de569-32fd-4d08-9186-faf06659aaf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b47de569-32fd-4d08-9186-faf06659aaf0', 'volume_size': 1} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-639018578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47de569-32fd-4d08-9186-faf06659aaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0347904bf4accaeda15cc0d20f72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:25Z,use_quota=True,user_id='432b5cc738ca4a5aadc5961fee5e0761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Creating volume b47de569-32fd-4d08-9186-faf06659aaf0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:19:24 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:19:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:25 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 1073741824 Jul 21 17:19:25 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:25 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 1073741824" returned: 0 in 0.603s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:25 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 Jul 21 17:19:25 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:26 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0" returned: 0 in 0.497s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d229711-e65a-4260-8048-7e17a35a9ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b47de569-32fd-4d08-9186-faf06659aaf0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f0fa31-e999-4b7d-98b1-a1869f719e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:26 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Volume volume-b47de569-32fd-4d08-9186-faf06659aaf0 (b47de569-32fd-4d08-9186-faf06659aaf0): created successfully Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f0fa31-e999-4b7d-98b1-a1869f719e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Flow 'volume_create_manager' (9b2e09cf-064a-41f9-9169-250a55e67fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-76778049-ea29-4df4-9e96-f4dc1362b2d2 tempest-AttachVolumeTestJSON-1186318522 None] Created volume successfully. Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=63,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Flow 'volume_create_manager' (70f8078e-1215-4389-8203-55dc8f330055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7f1345-7e68-454a-9c0a-fc4087e385be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7f1345-7e68-454a-9c0a-fc4087e385be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-35172720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365b3349-0043-4d42-9614-6e6bdcf969d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae88e7e01be3476790c002a7ff209f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:27Z,use_quota=True,user_id='6820012146364c569440f6970393226b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288fea11-32e2-4819-98e3-6d69b629b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288fea11-32e2-4819-98e3-6d69b629b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc51f886-0abe-492b-b1ee-39401eb261a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc51f886-0abe-492b-b1ee-39401eb261a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365b3349-0043-4d42-9614-6e6bdcf969d4', 'volume_name': 'volume-365b3349-0043-4d42-9614-6e6bdcf969d4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d0084b-aec6-43e5-9265-3d0198f1be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d0084b-aec6-43e5-9265-3d0198f1be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0bab1f-f05f-4cf4-9629-3495f30b7121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Volume 365b3349-0043-4d42-9614-6e6bdcf969d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365b3349-0043-4d42-9614-6e6bdcf969d4', 'volume_size': 1} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-35172720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365b3349-0043-4d42-9614-6e6bdcf969d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae88e7e01be3476790c002a7ff209f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:27Z,use_quota=True,user_id='6820012146364c569440f6970393226b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Creating volume 365b3349-0043-4d42-9614-6e6bdcf969d4 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:19:27 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:19:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:27 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 1073741824 Jul 21 17:19:27 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-db7d6d05-8130-4f59-98e4-19318b252e15 req-11e6a52b-bcb2-4a9c-aecd-222f42871d4e tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:28 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 1073741824" returned: 0 in 0.858s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:28 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 Jul 21 17:19:28 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:28 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-db7d6d05-8130-4f59-98e4-19318b252e15 req-11e6a52b-bcb2-4a9c-aecd-222f42871d4e tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.319s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0bab1f-f05f-4cf4-9629-3495f30b7121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365b3349-0043-4d42-9614-6e6bdcf969d4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed5a220-c23a-41d4-827d-d221b0a6ed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-db7d6d05-8130-4f59-98e4-19318b252e15 req-11e6a52b-bcb2-4a9c-aecd-222f42871d4e tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Volume volume-365b3349-0043-4d42-9614-6e6bdcf969d4 (365b3349-0043-4d42-9614-6e6bdcf969d4): created successfully Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed5a220-c23a-41d4-827d-d221b0a6ed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Flow 'volume_create_manager' (70f8078e-1215-4389-8203-55dc8f330055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-826f58fc-abb2-4462-9373-f1545ef0158e tempest-VolumeQuotasAdminTestJSON-49212707 None] Created volume successfully. Jul 21 17:19:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-db7d6d05-8130-4f59-98e4-19318b252e15 req-11e6a52b-bcb2-4a9c-aecd-222f42871d4e tempest-AttachVolumeTestJSON-1186318522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-b47de569-32fd-4d08-9186-faf06659aaf0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3acb072e-dbc3-462f-9b96-ae74116e807f', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:19:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-db7d6d05-8130-4f59-98e4-19318b252e15 req-11e6a52b-bcb2-4a9c-aecd-222f42871d4e tempest-AttachVolumeTestJSON-1186318522 None] attachment_update completed successfully. Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "cinder-365b3349-0043-4d42-9614-6e6bdcf969d4-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "cinder-365b3349-0043-4d42-9614-6e6bdcf969d4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "cinder-quobyte-365b3349-0043-4d42-9614-6e6bdcf969d4" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "cinder-quobyte-365b3349-0043-4d42-9614-6e6bdcf969d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64633c-83cf-4ff3-91b0-09ce7bb82c45]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:29 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 Jul 21 17:19:29 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:29 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:29 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4 Jul 21 17:19:29 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:30 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-365b3349-0043-4d42-9614-6e6bdcf969d4" returned: 0 in 0.361s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "cinder-quobyte-365b3349-0043-4d42-9614-6e6bdcf969d4" released by "delete_volume" :: held 0.893s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Created reservations ['4bfb67fa-cea6-44b6-b18f-4e22d6897f0a', '1f1729cb-d65a-4093-b3a3-2f866481c5ec', 'e5116d17-0dce-44fc-9907-5bcf6deacde1', '636ab6f0-5ed1-45cc-bdb4-0d4a2ae44277'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:30 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:30 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:31 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.627s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:31 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Deleted volume successfully. Jul 21 17:19:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37bd1c50-8e09-4a56-88f9-8af202c9232e tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "cinder-365b3349-0043-4d42-9614-6e6bdcf969d4-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-71001ef7-4d3d-4e2c-868b-f88d3df00adf req-cb76682e-c649-436d-88c2-24f405d25bdf tempest-AttachVolumeTestJSON-1186318522 None] Terminate volume connection completed successfully. Jul 21 17:19:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-71001ef7-4d3d-4e2c-868b-f88d3df00adf req-cb76682e-c649-436d-88c2-24f405d25bdf tempest-AttachVolumeTestJSON-1186318522 None] Deleting attachment e0e76d96-8edf-4b1f-97ac-f089eb27030c. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Flow 'volume_create_manager' (5a10207b-3d38-49f0-81a0-9f738072393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5030ab1-41bd-4b74-8576-ae8d4eeffe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5030ab1-41bd-4b74-8576-ae8d4eeffe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1921864934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3bb64c-7732-4896-9051-e30a12ed0408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae88e7e01be3476790c002a7ff209f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:32Z,use_quota=True,user_id='6820012146364c569440f6970393226b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581fc8e0-8d29-43a0-af54-aebce6a50707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581fc8e0-8d29-43a0-af54-aebce6a50707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4061fe5-0d0e-4a7f-be1b-9df1bc2a6461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4061fe5-0d0e-4a7f-be1b-9df1bc2a6461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3bb64c-7732-4896-9051-e30a12ed0408', 'volume_name': 'volume-ab3bb64c-7732-4896-9051-e30a12ed0408', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2be85-38a6-4951-bdba-51338c308244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2be85-38a6-4951-bdba-51338c308244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff629d9-a14d-4414-83b3-9844fe3cf8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:32 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Volume ab3bb64c-7732-4896-9051-e30a12ed0408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3bb64c-7732-4896-9051-e30a12ed0408', 'volume_size': 1} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1921864934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3bb64c-7732-4896-9051-e30a12ed0408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae88e7e01be3476790c002a7ff209f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:32Z,use_quota=True,user_id='6820012146364c569440f6970393226b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Creating volume ab3bb64c-7732-4896-9051-e30a12ed0408 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:19:32 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:19:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:32 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 1073741824 Jul 21 17:19:32 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:33 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 1073741824" returned: 0 in 0.666s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-fb8540dd-f183-4b20-8182-d17efa22066d req-01f8b580-657f-4897-acef-500facbd7463 tempest-AttachVolumeTestJSON-1186318522 None] Terminate volume connection completed successfully. Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-fb8540dd-f183-4b20-8182-d17efa22066d req-01f8b580-657f-4897-acef-500facbd7463 tempest-AttachVolumeTestJSON-1186318522 None] Deleting attachment 3acb072e-dbc3-462f-9b96-ae74116e807f. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:33 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 Jul 21 17:19:33 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:33 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408" returned: 0 in 0.427s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff629d9-a14d-4414-83b3-9844fe3cf8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3bb64c-7732-4896-9051-e30a12ed0408', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dd6ba0-38e8-4608-81de-1c305222ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:33 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Volume volume-ab3bb64c-7732-4896-9051-e30a12ed0408 (ab3bb64c-7732-4896-9051-e30a12ed0408): created successfully Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dd6ba0-38e8-4608-81de-1c305222ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Flow 'volume_create_manager' (5a10207b-3d38-49f0-81a0-9f738072393b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d70e8050-a67f-4aee-a945-6c67720aa77c tempest-VolumeQuotasAdminTestJSON-49212707 None] Created volume successfully. Jul 21 17:19:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-bd8b079a-7377-466d-b542-13cb0c288c0c tempest-VolumeQuotasAdminTestJSON-35173201 None] Transfer volume completed successfully. Jul 21 17:19:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Acquiring lock "cinder-ab3bb64c-7732-4896-9051-e30a12ed0408-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Lock "cinder-ab3bb64c-7732-4896-9051-e30a12ed0408-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Acquiring lock "cinder-quobyte-ab3bb64c-7732-4896-9051-e30a12ed0408" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Lock "cinder-quobyte-ab3bb64c-7732-4896-9051-e30a12ed0408" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:36 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e9459-07f8-4d84-8638-34a0a56a8a1a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:19:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:37 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 Jul 21 17:19:37 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:37 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408" returned: 0 in 0.449s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:37 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408 Jul 21 17:19:37 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:37 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ab3bb64c-7732-4896-9051-e30a12ed0408" returned: 0 in 0.410s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:37 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Lock "cinder-quobyte-ab3bb64c-7732-4896-9051-e30a12ed0408" released by "delete_volume" :: held 0.914s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:37 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Created reservations ['33521eb9-ed54-4376-8704-f8794bece040', '0ee16657-ead7-4495-8ae9-0a3e8665c799', 'de83dd78-8ec7-4dc2-a3ae-d254297c17cd', '5a178813-3809-4866-9ddc-e2478ccc12f0'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:38 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:38 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:38 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.378s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Deleted volume successfully. Jul 21 17:19:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-934e91f0-bedc-4019-b311-1300de24393d tempest-VolumeQuotasAdminTestJSON-454728294 None] Lock "cinder-ab3bb64c-7732-4896-9051-e30a12ed0408-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "cinder-b47de569-32fd-4d08-9186-faf06659aaf0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-b47de569-32fd-4d08-9186-faf06659aaf0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "cinder-quobyte-b47de569-32fd-4d08-9186-faf06659aaf0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-quobyte-b47de569-32fd-4d08-9186-faf06659aaf0" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82664c-35ae-4e84-b42b-464cc9f4e0bd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:19:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:42 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 Jul 21 17:19:42 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:42 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:42 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:42 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0" returned: 0 in 0.590s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:42 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0 Jul 21 17:19:42 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:42 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.638s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 8 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:19:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:19:43 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b47de569-32fd-4d08-9186-faf06659aaf0" returned: 0 in 0.751s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-quobyte-b47de569-32fd-4d08-9186-faf06659aaf0" released by "delete_volume" :: held 1.476s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Created reservations ['d3f963ed-83da-40eb-b853-13a444417ad1', '0e11a0d0-d7b6-44f9-897d-2186a73819ed', 'e20ce025-9f25-41f8-9c86-598c5f21bba3', '6cc93df8-315e-4cc0-8abd-bdff810892df'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:43 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:43 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:44 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.541s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Deleted volume successfully. Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40c3fc52-032c-4b06-b162-4e67a5bd486c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-b47de569-32fd-4d08-9186-faf06659aaf0-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "cinder-d3efed1f-f986-4c8e-81a6-cc36e5b0a843-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-d3efed1f-f986-4c8e-81a6-cc36e5b0a843-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "cinder-quobyte-d3efed1f-f986-4c8e-81a6-cc36e5b0a843" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-quobyte-d3efed1f-f986-4c8e-81a6-cc36e5b0a843" acquired by "delete_volume" :: waited 0.085s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b05d3f-f08e-4b76-90ab-95625b2e560d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:19:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:44 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 Jul 21 17:19:44 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:45 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843" returned: 0 in 0.592s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:45 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843 Jul 21 17:19:45 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:45 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d3efed1f-f986-4c8e-81a6-cc36e5b0a843" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-quobyte-d3efed1f-f986-4c8e-81a6-cc36e5b0a843" released by "delete_volume" :: held 1.062s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Created reservations ['5cd25a11-0aa6-4b65-88d3-521e166c59b6', 'a7745016-b314-4551-b2fa-a66dd673f6f3', '9289c5c0-5297-4e10-87e0-07ecea397600', '3836b739-c968-4688-b644-6a7a19aa4e2d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:45 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:45 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:46 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.601s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:46 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Deleted volume successfully. Jul 21 17:19:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7760f484-274a-4c68-8f32-1b97a421efeb tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-d3efed1f-f986-4c8e-81a6-cc36e5b0a843-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "cinder-ef64528a-730e-47f9-bef6-9fffb2aa8bc9-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-ef64528a-730e-47f9-bef6-9fffb2aa8bc9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "cinder-quobyte-ef64528a-730e-47f9-bef6-9fffb2aa8bc9" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:19:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-quobyte-ef64528a-730e-47f9-bef6-9fffb2aa8bc9" acquired by "delete_volume" :: waited 0.039s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:19:47 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb09f14-96b3-456a-acb7-5219b9ef18ab]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:19:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:47 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 Jul 21 17:19:47 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:48 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9" returned: 0 in 0.895s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:48 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9 Jul 21 17:19:48 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:48 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ef64528a-730e-47f9-bef6-9fffb2aa8bc9" returned: 0 in 0.587s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-quobyte-ef64528a-730e-47f9-bef6-9fffb2aa8bc9" released by "delete_volume" :: held 1.606s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Created reservations ['7ead59f2-f34b-4925-8993-28dd3709836d', 'fc4b29d9-58f5-42bc-9be8-3fc896a10bc2', 'b6b0b661-74d4-41d9-9f33-ac1ed9546a02', '0251de1d-e2e3-4058-b38e-f7fc01cbe611'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:49 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:19:49 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:49 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:19:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Deleted volume successfully. Jul 21 17:19:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7312c7fb-00e6-4bb3-b4d3-dd5e348b2c9c tempest-AttachVolumeTestJSON-1186318522 None] Lock "cinder-ef64528a-730e-47f9-bef6-9fffb2aa8bc9-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Flow 'volume_create_manager' (7056a6fd-c7ba-4625-83d3-14314367799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ecb438-c21e-40ad-9288-2dfec7c0e859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ecb438-c21e-40ad-9288-2dfec7c0e859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-896900119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c46521-2421-48e1-830a-59ef53ebbe21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61e0b961c14de2ab477ed5ec4c0980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:56Z,use_quota=True,user_id='eb6ff800d958452ab7dc106eca3734be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224f6c34-59d2-4a0d-b26f-9a4df9defdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224f6c34-59d2-4a0d-b26f-9a4df9defdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184bf886-56ea-4206-b741-6eb19cdfeffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184bf886-56ea-4206-b741-6eb19cdfeffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c46521-2421-48e1-830a-59ef53ebbe21', 'volume_name': 'volume-c6c46521-2421-48e1-830a-59ef53ebbe21', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3cb89-4fd9-4776-b846-ab0bce65d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3cb89-4fd9-4776-b846-ab0bce65d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503e9303-98db-41e5-b0ef-ad24d5876af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Volume c6c46521-2421-48e1-830a-59ef53ebbe21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c46521-2421-48e1-830a-59ef53ebbe21', 'volume_size': 1} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-896900119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c46521-2421-48e1-830a-59ef53ebbe21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61e0b961c14de2ab477ed5ec4c0980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:19:56Z,use_quota=True,user_id='eb6ff800d958452ab7dc106eca3734be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Creating volume c6c46521-2421-48e1-830a-59ef53ebbe21 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:19:55 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:19:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:55 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 1073741824 Jul 21 17:19:55 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:56 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 1073741824" returned: 0 in 0.577s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:19:56 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 Jul 21 17:19:56 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:19:56 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21" returned: 0 in 0.321s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503e9303-98db-41e5-b0ef-ad24d5876af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c46521-2421-48e1-830a-59ef53ebbe21', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbef9191-d2a6-47be-b0e8-24d6ceb979a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:19:56 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Volume volume-c6c46521-2421-48e1-830a-59ef53ebbe21 (c6c46521-2421-48e1-830a-59ef53ebbe21): created successfully Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbef9191-d2a6-47be-b0e8-24d6ceb979a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:19:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Flow 'volume_create_manager' (7056a6fd-c7ba-4625-83d3-14314367799d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:19:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-33d90ce9-df59-40cb-b4c3-1edd2ad04f3b tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Created volume successfully. Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Acquiring lock "cinder-c6c46521-2421-48e1-830a-59ef53ebbe21-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "cinder-c6c46521-2421-48e1-830a-59ef53ebbe21-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Acquiring lock "cinder-quobyte-c6c46521-2421-48e1-830a-59ef53ebbe21" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "cinder-quobyte-c6c46521-2421-48e1-830a-59ef53ebbe21" acquired by "delete_volume" :: waited 0.046s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a56e6-de01-43bf-81fd-ba3c803efe78]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:00 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 Jul 21 17:20:00 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:00 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21" returned: 0 in 0.485s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:00 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21 Jul 21 17:20:00 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:01 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c6c46521-2421-48e1-830a-59ef53ebbe21" returned: 0 in 0.250s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "cinder-quobyte-c6c46521-2421-48e1-830a-59ef53ebbe21" released by "delete_volume" :: held 0.805s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Created reservations ['fdbba6f5-0f79-458d-b59e-975e1f703529', 'c8622800-477d-403d-9b59-b88eb6f70758', 'e01b1faa-86ef-487c-9efa-f81547ed553a', '44c348c0-cc1c-480d-acb7-7bdd51a29d60'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:01 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:01 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:01 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.606s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:01 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Deleted volume successfully. Jul 21 17:20:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58190cc0-5138-459d-8895-21b90b6599c5 tempest-VolumeQuotasNegativeTestJSON-1394869312 None] Lock "cinder-c6c46521-2421-48e1-830a-59ef53ebbe21-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Flow 'volume_create_manager' (47511d72-9350-47c2-aa4a-4eee7f7e0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9516929b-c09d-4e8f-bb2d-f6c72114d21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9516929b-c09d-4e8f-bb2d-f6c72114d21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-8013435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea51303b-f3c3-4b7a-8eaf-f8869f0da468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c150cccb454396a373c538710e2505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:05Z,use_quota=True,user_id='c2774c827f274d5cbd226c592b59af83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d99ff6b-69b0-420b-9444-7fa728c0e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d99ff6b-69b0-420b-9444-7fa728c0e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb8b960-d44e-4a44-bb94-0307cae23d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb8b960-d44e-4a44-bb94-0307cae23d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea51303b-f3c3-4b7a-8eaf-f8869f0da468', 'volume_name': 'volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c4cc5-755a-4aac-bfe1-54cdd9f69b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c4cc5-755a-4aac-bfe1-54cdd9f69b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1486f4-e778-48de-b259-fc7e4402578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Volume ea51303b-f3c3-4b7a-8eaf-f8869f0da468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468', 'volume_size': 1} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-8013435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea51303b-f3c3-4b7a-8eaf-f8869f0da468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c150cccb454396a373c538710e2505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:05Z,use_quota=True,user_id='c2774c827f274d5cbd226c592b59af83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Creating volume ea51303b-f3c3-4b7a-8eaf-f8869f0da468 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:05 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:05 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 1073741824 Jul 21 17:20:05 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:06 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 1073741824" returned: 0 in 0.644s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:06 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 Jul 21 17:20:06 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:06 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1486f4-e778-48de-b259-fc7e4402578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc525a7c-ae62-424b-bc7d-d157f20dcf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:06 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Volume volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 (ea51303b-f3c3-4b7a-8eaf-f8869f0da468): created successfully Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc525a7c-ae62-424b-bc7d-d157f20dcf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Flow 'volume_create_manager' (47511d72-9350-47c2-aa4a-4eee7f7e0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e6299b4b-c3f9-4f22-a7cf-631d42ea629b tempest-ServersNegativeTestJSON-1882563751 None] Created volume successfully. Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Flow 'volume_create_manager' (ede4eade-4177-418e-b4c2-1a36597bbfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2697a6d3-f4b3-43a2-bbed-a271cfb766da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2697a6d3-f4b3-43a2-bbed-a271cfb766da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-275705605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caaae838-c1f7-420c-a255-782d040df039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdecc015f97d45dd9e034792d4e56174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:08Z,use_quota=True,user_id='767017f4ba5a4cbfabc52afe5275499f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9898ccbc-77e2-49b2-bb07-093e281aacfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9898ccbc-77e2-49b2-bb07-093e281aacfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2f6cb7-090f-4c4b-bb82-1ac965370e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2f6cb7-090f-4c4b-bb82-1ac965370e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caaae838-c1f7-420c-a255-782d040df039', 'volume_name': 'volume-caaae838-c1f7-420c-a255-782d040df039', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d290748-9b23-4393-b297-0e2793b911c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d290748-9b23-4393-b297-0e2793b911c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615ffd11-dda1-432c-95b8-ca832aec171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:07 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Volume caaae838-c1f7-420c-a255-782d040df039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caaae838-c1f7-420c-a255-782d040df039', 'volume_size': 1} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-275705605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caaae838-c1f7-420c-a255-782d040df039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdecc015f97d45dd9e034792d4e56174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:08Z,use_quota=True,user_id='767017f4ba5a4cbfabc52afe5275499f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Creating volume caaae838-c1f7-420c-a255-782d040df039 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:07 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:08 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 1073741824 Jul 21 17:20:08 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:08 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 1073741824" returned: 0 in 0.596s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:08 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 Jul 21 17:20:08 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:08 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039" returned: 0 in 0.357s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615ffd11-dda1-432c-95b8-ca832aec171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caaae838-c1f7-420c-a255-782d040df039', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e855db5-06b4-4219-b618-fd7d4182812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:09 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Volume volume-caaae838-c1f7-420c-a255-782d040df039 (caaae838-c1f7-420c-a255-782d040df039): created successfully Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e855db5-06b4-4219-b618-fd7d4182812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Flow 'volume_create_manager' (ede4eade-4177-418e-b4c2-1a36597bbfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:09 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-aee8ecbb-3479-4ade-961d-f97ceadf7246 tempest-AttachVolumeNegativeTest-1288094069 None] Created volume successfully. Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Flow 'volume_create_manager' (661be697-b197-4558-91de-f3b43242d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0463119-ac65-4d21-833f-779f2506a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0463119-ac65-4d21-833f-779f2506a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1647454070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ab60f0-a6cc-4aab-897c-7ccd04edc6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c150cccb454396a373c538710e2505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:09Z,use_quota=True,user_id='c2774c827f274d5cbd226c592b59af83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad51dc0-e1b0-4908-9141-ae3b8b594fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad51dc0-e1b0-4908-9141-ae3b8b594fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c777acee-f9e9-4b08-a4b6-023e66f7f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c777acee-f9e9-4b08-a4b6-023e66f7f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ab60f0-a6cc-4aab-897c-7ccd04edc6a6', 'volume_name': 'volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4070319b-0307-437c-a023-56ff9066c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4070319b-0307-437c-a023-56ff9066c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcad227a-327d-4112-966b-2f5ff02f477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:09 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Volume 83ab60f0-a6cc-4aab-897c-7ccd04edc6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6', 'volume_size': 1} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1647454070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ab60f0-a6cc-4aab-897c-7ccd04edc6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c150cccb454396a373c538710e2505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:09Z,use_quota=True,user_id='c2774c827f274d5cbd226c592b59af83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Creating volume 83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:09 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:09 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 1073741824 Jul 21 17:20:09 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:10 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 1073741824" returned: 0 in 0.518s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:10 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 Jul 21 17:20:10 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:10 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6" returned: 0 in 0.302s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcad227a-327d-4112-966b-2f5ff02f477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72af3c27-92ee-48d3-a9f9-21bd67bb456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:10 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Volume volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 (83ab60f0-a6cc-4aab-897c-7ccd04edc6a6): created successfully Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72af3c27-92ee-48d3-a9f9-21bd67bb456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Flow 'volume_create_manager' (661be697-b197-4558-91de-f3b43242d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-bf091f82-69e3-40c3-9251-8fba2fc41d8b tempest-ServersNegativeTestJSON-1882563751 None] Created volume successfully. Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-8f923969-4e5e-4a11-b87a-f4268921567e req-56ea86c2-8dcf-43d6-83f6-743098d89ffb tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-8f923969-4e5e-4a11-b87a-f4268921567e req-56ea86c2-8dcf-43d6-83f6-743098d89ffb tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-8f923969-4e5e-4a11-b87a-f4268921567e req-56ea86c2-8dcf-43d6-83f6-743098d89ffb tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7d73b29b-a907-4daf-b28b-f407c5b80022 tempest-GroupsTest-645013563 None] Group tempest-Group1-805584218: creating Jul 21 17:20:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-8f923969-4e5e-4a11-b87a-f4268921567e req-56ea86c2-8dcf-43d6-83f6-743098d89ffb tempest-AttachVolumeNegativeTest-1288094069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-caaae838-c1f7-420c-a255-782d040df039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4311c20f-1078-4af8-a9d1-908b49e25471', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:20:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7d73b29b-a907-4daf-b28b-f407c5b80022 tempest-GroupsTest-645013563 None] Group tempest-Group1-805584218: created successfully Jul 21 17:20:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7d73b29b-a907-4daf-b28b-f407c5b80022 tempest-GroupsTest-645013563 None] Create group completed successfully. Jul 21 17:20:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-8f923969-4e5e-4a11-b87a-f4268921567e req-56ea86c2-8dcf-43d6-83f6-743098d89ffb tempest-AttachVolumeNegativeTest-1288094069 None] attachment_update completed successfully. Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "cinder-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "cinder-quobyte-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-quobyte-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db3716-3b83-42ce-b1f8-535926540070]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1afbdb65-2a2c-4795-b176-5d0aef7bfc1b tempest-GroupsTest-645013563 None] Group tempest-Group2-500394267: creating Jul 21 17:20:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1afbdb65-2a2c-4795-b176-5d0aef7bfc1b tempest-GroupsTest-645013563 None] Group tempest-Group2-500394267: created successfully Jul 21 17:20:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1afbdb65-2a2c-4795-b176-5d0aef7bfc1b tempest-GroupsTest-645013563 None] Create group completed successfully. Jul 21 17:20:12 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 Jul 21 17:20:12 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:12 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:12 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6 Jul 21 17:20:12 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:12 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-quobyte-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6" released by "delete_volume" :: held 0.684s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:12 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Created reservations ['0be9d6b7-aca7-4b91-8001-c388e03c214b', 'f162e788-5a48-470c-80b8-42f327df5522', 'f50d8ae6-f584-41bd-beb8-4e0211d77650', '01607aca-c2d5-48eb-8139-7d666a3688c7'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:13 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:13 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "cinder-ea51303b-f3c3-4b7a-8eaf-f8869f0da468-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-ea51303b-f3c3-4b7a-8eaf-f8869f0da468-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:13 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.376s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Deleted volume successfully. Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "cinder-quobyte-ea51303b-f3c3-4b7a-8eaf-f8869f0da468" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f2cc4d0-ebcd-419e-9ba3-6fa7ab9a832e tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-83ab60f0-a6cc-4aab-897c-7ccd04edc6a6-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-quobyte-ea51303b-f3c3-4b7a-8eaf-f8869f0da468" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46f3704-1b26-43cc-819b-3accc78e3cc7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:13 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 Jul 21 17:20:13 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-9462d0fa-4268-43cc-b270-219f598b71c5 req-db61c8af-eb38-450c-bc0f-29fade11191f tempest-AttachVolumeNegativeTest-1288094069 None] Terminate volume connection completed successfully. Jul 21 17:20:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-9462d0fa-4268-43cc-b270-219f598b71c5 req-db61c8af-eb38-450c-bc0f-29fade11191f tempest-AttachVolumeNegativeTest-1288094069 None] Deleting attachment 4311c20f-1078-4af8-a9d1-908b49e25471. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:20:14 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468" returned: 0 in 0.554s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:14 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468 Jul 21 17:20:14 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=89,cinder:INSERT=15,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Flow 'volume_create_manager' (14a68c92-552f-4d32-b4f7-de0c9cd059b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b25849-65c2-421d-b318-e1ac4a8aac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b25849-65c2-421d-b318-e1ac4a8aac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150235575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25723070-eedd-4e07-a796-5b09fb33f151,host='devstack@QuobyteHD#QuobyteHD',id=0ca1761b-15c2-426a-9a7a-fcd75b4d91c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983c228d56446f59c226fe03cbba51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:14Z,use_quota=True,user_id='7d13e0038069456cbca2800fab900a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f69e772-4e5b-442c-827a-0be62afda317),volume_type_id=4f69e772-4e5b-442c-827a-0be62afda317)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45323f1e-7d08-4b47-a72c-c5eb4265f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45323f1e-7d08-4b47-a72c-c5eb4265f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275c37a9-eebc-4ff5-a0e8-d0bac9d16e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275c37a9-eebc-4ff5-a0e8-d0bac9d16e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca1761b-15c2-426a-9a7a-fcd75b4d91c3', 'volume_name': 'volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b0d933d-5d1c-4298-aa70-d422eac3d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b0d933d-5d1c-4298-aa70-d422eac3d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f147ace2-c46e-41e9-8809-f6b1ee5d6d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Volume 0ca1761b-15c2-426a-9a7a-fcd75b4d91c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3', 'volume_size': 1} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25723070-eedd-4e07-a796-5b09fb33f151,created_at=2026-07-21T15:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150235575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25723070-eedd-4e07-a796-5b09fb33f151,host='devstack@QuobyteHD#QuobyteHD',id=0ca1761b-15c2-426a-9a7a-fcd75b4d91c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983c228d56446f59c226fe03cbba51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:14Z,use_quota=True,user_id='7d13e0038069456cbca2800fab900a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f69e772-4e5b-442c-827a-0be62afda317),volume_type_id=4f69e772-4e5b-442c-827a-0be62afda317)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Creating volume 0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:14 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:14 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 1073741824 Jul 21 17:20:14 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:14 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ea51303b-f3c3-4b7a-8eaf-f8869f0da468" returned: 0 in 0.397s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-quobyte-ea51303b-f3c3-4b7a-8eaf-f8869f0da468" released by "delete_volume" :: held 1.013s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Created reservations ['8d1b83e0-a393-44a8-a675-13c6371c7845', 'b724e1ff-fa0c-4559-b707-db3570f76900', 'c06aa33b-98b5-4066-bcd5-7529fbab4e8e', '0b607ed6-4c5e-4686-bb52-c75ba9784af4'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:14 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:14 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:14 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 1073741824" returned: 0 in 0.597s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:14 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:14 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:15 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 Jul 21 17:20:15 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Deleted volume successfully. Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9fd0a3f4-45ad-4872-bad0-7cc27de9c935 tempest-ServersNegativeTestJSON-1882563751 None] Lock "cinder-ea51303b-f3c3-4b7a-8eaf-f8869f0da468-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:15 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3" returned: 0 in 0.431s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f147ace2-c46e-41e9-8809-f6b1ee5d6d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a8645b-a5f3-4704-8369-32d04cdd05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Volume volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 (0ca1761b-15c2-426a-9a7a-fcd75b4d91c3): created successfully Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a8645b-a5f3-4704-8369-32d04cdd05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Flow 'volume_create_manager' (14a68c92-552f-4d32-b4f7-de0c9cd059b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8608022c-d241-4a4d-9190-e3b5fa66d8d3 tempest-GroupsTest-645013563 None] Created volume successfully. Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Flow 'volume_create_manager' (860635c8-1d2c-4edc-8755-90df18b2d68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d72ed1-30b5-4f81-a33a-97b44ba21c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d72ed1-30b5-4f81-a33a-97b44ba21c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-302955760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3a84d6-0811-408b-af71-9fb7467c73c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fa24ba7d69407ebd425451b4b50c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:17Z,use_quota=True,user_id='64265c006fde4fc098bca66293386533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e966632f-4db5-4195-be2f-758a36e07056),volume_type_id=e966632f-4db5-4195-be2f-758a36e07056)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cf4f57-234b-421b-8426-6fad2280a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cf4f57-234b-421b-8426-6fad2280a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ea262c-4b5d-49a5-99cc-397b21a43dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ea262c-4b5d-49a5-99cc-397b21a43dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3a84d6-0811-408b-af71-9fb7467c73c8', 'volume_name': 'volume-2a3a84d6-0811-408b-af71-9fb7467c73c8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078c40d4-1476-4f0a-87bc-5cf50b951ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078c40d4-1476-4f0a-87bc-5cf50b951ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c8e296-1aad-456c-9318-1103b2be77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Volume 2a3a84d6-0811-408b-af71-9fb7467c73c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3a84d6-0811-408b-af71-9fb7467c73c8', 'volume_size': 1} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-302955760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3a84d6-0811-408b-af71-9fb7467c73c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fa24ba7d69407ebd425451b4b50c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:17Z,use_quota=True,user_id='64265c006fde4fc098bca66293386533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e966632f-4db5-4195-be2f-758a36e07056),volume_type_id=e966632f-4db5-4195-be2f-758a36e07056)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Creating volume 2a3a84d6-0811-408b-af71-9fb7467c73c8 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:16 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 1073741824 Jul 21 17:20:16 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Acquiring lock "cinder-quobyte-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Lock "cinder-quobyte-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3" acquired by "delete_volume" :: waited 0.066s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:17 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf7ad7-607d-46a0-be2e-74afc5ef369d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:17 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 1073741824" returned: 0 in 0.873s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:17 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 Jul 21 17:20:17 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:17 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 Jul 21 17:20:17 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:18 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3" returned: 0 in 0.488s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:18 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3 Jul 21 17:20:18 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:18 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8" returned: 0 in 0.357s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c8e296-1aad-456c-9318-1103b2be77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3a84d6-0811-408b-af71-9fb7467c73c8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1261d3-3af7-4e1b-a29d-56feb27c23c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Volume volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 (2a3a84d6-0811-408b-af71-9fb7467c73c8): created successfully Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1261d3-3af7-4e1b-a29d-56feb27c23c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Flow 'volume_create_manager' (860635c8-1d2c-4edc-8755-90df18b2d68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-52ea8994-4d33-42e7-98a7-2a6ce1ecbad1 tempest-VolumeTypesAccessTest-158897369 None] Created volume successfully. Jul 21 17:20:18 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3" returned: 0 in 0.262s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Lock "cinder-quobyte-0ca1761b-15c2-426a-9a7a-fcd75b4d91c3" released by "delete_volume" :: held 0.813s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Created reservations ['107bb6fa-d9a1-40e5-926a-5f2595a2cb1b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:18 devstack cinder-volume[87591]: WARNING cinder.quota [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-183079402 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-183079402, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:18 devstack cinder-volume[87591]: WARNING cinder.quota [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-183079402 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-183079402, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Created reservations ['a8d2e6c9-0086-43d4-8a56-a1908500352d', '0d5d221c-6db9-4ca2-8a7e-f00a7dab6959', '4cc04828-421a-4c5c-92cb-8c89a218f390', '3fbedfe1-1926-4485-8dd2-806bd9882d24'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:18 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:18 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:19 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.304s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0316c6f7-7836-4afe-b6d0-0f0f6e8ff878 tempest-GroupsTest-645013563 None] Delete group completed successfully. Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Acquiring lock "cinder-2a3a84d6-0811-408b-af71-9fb7467c73c8-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Lock "cinder-2a3a84d6-0811-408b-af71-9fb7467c73c8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Created reservations ['68cec7f4-35e7-4227-adcd-31a83aa8c470'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Acquiring lock "cinder-quobyte-2a3a84d6-0811-408b-af71-9fb7467c73c8" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Lock "cinder-quobyte-2a3a84d6-0811-408b-af71-9fb7467c73c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6d6e1-5306-4731-aa07-c2bf7b7ea0f5]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:19 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:19 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:19 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 Jul 21 17:20:19 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:19 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5521319e-c17a-4f7d-a006-06a4dbfdd2a1 tempest-GroupsTest-645013563 None] Delete group completed successfully. Jul 21 17:20:19 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:19 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8 Jul 21 17:20:19 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "cinder-caaae838-c1f7-420c-a255-782d040df039-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-caaae838-c1f7-420c-a255-782d040df039-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "cinder-quobyte-caaae838-c1f7-420c-a255-782d040df039" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:20 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2a3a84d6-0811-408b-af71-9fb7467c73c8" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-quobyte-caaae838-c1f7-420c-a255-782d040df039" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Lock "cinder-quobyte-2a3a84d6-0811-408b-af71-9fb7467c73c8" released by "delete_volume" :: held 0.760s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5586279a-3a6d-44c3-acf5-7b44463170cb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:20 devstack cinder-volume[87591]: WARNING cinder.quota [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2122805097 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2122805097, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:20 devstack cinder-volume[87591]: WARNING cinder.quota [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2122805097 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2122805097, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Created reservations ['1d5b8dce-8216-4943-9a76-d264ae5daf7a', 'c00b064f-ded5-41fe-bc1a-55581ff4dce5', '7b4d8e68-4ac4-41f0-8996-75635439d87e', '31f63ea8-39f0-47c6-85c0-23b1b96be643'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:20 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 Jul 21 17:20:20 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:20 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:20 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:20 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.408s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Deleted volume successfully. Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-61a8f45d-a7d2-4bfa-a6db-604d2ae008b6 tempest-VolumeTypesAccessTest-158897369 None] Lock "cinder-2a3a84d6-0811-408b-af71-9fb7467c73c8-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:20 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039" returned: 0 in 0.596s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:20 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039 Jul 21 17:20:20 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ebdede6c-5c06-4321-bdf9-a4c37e19caae tempest-GroupsTest-645013563 None] Group tempest-GroupsTest-Group-1748908063: creating Jul 21 17:20:21 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-caaae838-c1f7-420c-a255-782d040df039" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-quobyte-caaae838-c1f7-420c-a255-782d040df039" released by "delete_volume" :: held 0.952s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ebdede6c-5c06-4321-bdf9-a4c37e19caae tempest-GroupsTest-645013563 None] Group tempest-GroupsTest-Group-1748908063: created successfully Jul 21 17:20:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ebdede6c-5c06-4321-bdf9-a4c37e19caae tempest-GroupsTest-645013563 None] Create group completed successfully. Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Created reservations ['c45d666d-bc2b-4b2c-aa57-5a7f4241245e', '0ea98aef-02d8-490a-94b6-680135dfec49', 'f2df84c8-59a8-450a-a3a5-a7efab993d95', 'ed2fd465-996e-4b00-b461-b6defe700283'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:21 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:21 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:21 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Deleted volume successfully. Jul 21 17:20:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7173b9e0-d207-47b4-b344-2515ee0ef385 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-caaae838-c1f7-420c-a255-782d040df039-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "cinder-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "cinder-quobyte-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-quobyte-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924" acquired by "delete_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4139398c-e960-45e8-a332-f202a3494476]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:22 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 Jul 21 17:20:22 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Flow 'volume_create_manager' (c22c27df-8e30-4e07-93d4-1f1effe964b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212c24d4-77b1-460f-bd56-824c1e20696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212c24d4-77b1-460f-bd56-824c1e20696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-760168952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcfa0ad3-e7be-4656-bab1-0b14c1c1abb0,host='devstack@QuobyteHD#QuobyteHD',id=57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983c228d56446f59c226fe03cbba51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:23Z,use_quota=True,user_id='7d13e0038069456cbca2800fab900a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a3808b1-9565-4a96-94aa-15599c3d91a0),volume_type_id=7a3808b1-9565-4a96-94aa-15599c3d91a0)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263e9779-f5dd-4185-8db3-e2f96871ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263e9779-f5dd-4185-8db3-e2f96871ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22aa1042-770d-4d5b-b72a-460266e067df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22aa1042-770d-4d5b-b72a-460266e067df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e', 'volume_name': 'volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64afb1d-d2c8-4f6b-90b8-bcb99664bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64afb1d-d2c8-4f6b-90b8-bcb99664bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b394cd-df96-4a1b-a6fa-c6e3090aedd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Volume 57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e', 'volume_size': 1} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bcfa0ad3-e7be-4656-bab1-0b14c1c1abb0,created_at=2026-07-21T15:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-760168952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcfa0ad3-e7be-4656-bab1-0b14c1c1abb0,host='devstack@QuobyteHD#QuobyteHD',id=57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983c228d56446f59c226fe03cbba51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:23Z,use_quota=True,user_id='7d13e0038069456cbca2800fab900a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a3808b1-9565-4a96-94aa-15599c3d91a0),volume_type_id=7a3808b1-9565-4a96-94aa-15599c3d91a0)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Creating volume 57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:23 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:23 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924" returned: 0 in 0.605s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:23 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e 1073741824 Jul 21 17:20:23 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:23 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924 Jul 21 17:20:23 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:23 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924" returned: 0 in 0.368s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-quobyte-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924" released by "delete_volume" :: held 1.059s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Created reservations ['7b27422f-2a87-47df-af5f-c895bee3f270', '147d87bb-91ca-4149-9989-632703495e9d', 'aba566f7-0f5e-45e0-ac89-392d8394cf3b', 'b4b86242-75ad-432f-8039-ee27fbe49bc9'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:23 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:23 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:23 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e 1073741824" returned: 0 in 0.646s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:23 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e Jul 21 17:20:23 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:24 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Deleted volume successfully. Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5100ea5d-520a-494a-ac24-da00d2784bee tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-d4ff005d-6317-4ef5-bfbf-f38d3f0f7924-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:24 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e" returned: 0 in 0.396s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b394cd-df96-4a1b-a6fa-c6e3090aedd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba4d14-5603-43b6-982e-2a7d4fb27746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Volume volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e (57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e): created successfully Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba4d14-5603-43b6-982e-2a7d4fb27746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Flow 'volume_create_manager' (c22c27df-8e30-4e07-93d4-1f1effe964b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-159dba49-363c-4c1d-bf01-b00a977fb06c tempest-GroupsTest-645013563 None] Created volume successfully. Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "cinder-e11ec965-2868-4e04-86e3-17647fa8cb04-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-e11ec965-2868-4e04-86e3-17647fa8cb04-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "cinder-quobyte-e11ec965-2868-4e04-86e3-17647fa8cb04" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-quobyte-e11ec965-2868-4e04-86e3-17647fa8cb04" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[856014ed-9186-4d79-ba33-0f5ab17afcf2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:25 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 Jul 21 17:20:25 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:25 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:25 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04 Jul 21 17:20:25 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:25 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e11ec965-2868-4e04-86e3-17647fa8cb04" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-quobyte-e11ec965-2868-4e04-86e3-17647fa8cb04" released by "delete_volume" :: held 0.831s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Created reservations ['4d7df728-f68b-4224-88a6-fc8b3ed16c6b', 'd94ad301-eca3-4696-a3d5-d3dd5e86a32a', '261b5936-20cf-4c93-a0e0-c177d5dbc4e3', '9db1be32-b66d-43bb-8a6d-8bd0b66ca8a5'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:26 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:26 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Flow 'volume_create_manager' (52d62b77-2a9f-492f-9cba-33aee7f285ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9ea3f-5371-4e28-8503-c6d7864cf8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9ea3f-5371-4e28-8503-c6d7864cf8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208982533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcfa0ad3-e7be-4656-bab1-0b14c1c1abb0,host='devstack@QuobyteHD#QuobyteHD',id=ee6d150f-4a24-46ca-9941-17cb6f3d5581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983c228d56446f59c226fe03cbba51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:26Z,use_quota=True,user_id='7d13e0038069456cbca2800fab900a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a3808b1-9565-4a96-94aa-15599c3d91a0),volume_type_id=7a3808b1-9565-4a96-94aa-15599c3d91a0)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881c57ff-a7b7-4a62-8a6c-58070ab30564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881c57ff-a7b7-4a62-8a6c-58070ab30564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6b04a3-84a7-472b-9f50-074f01183173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6b04a3-84a7-472b-9f50-074f01183173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6d150f-4a24-46ca-9941-17cb6f3d5581', 'volume_name': 'volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01046553-0caf-4b18-a970-d899db553f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01046553-0caf-4b18-a970-d899db553f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576fbc1a-42e5-4505-86b3-0a3fe3174d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:26 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Volume ee6d150f-4a24-46ca-9941-17cb6f3d5581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581', 'volume_size': 1} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bcfa0ad3-e7be-4656-bab1-0b14c1c1abb0,created_at=2026-07-21T15:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208982533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcfa0ad3-e7be-4656-bab1-0b14c1c1abb0,host='devstack@QuobyteHD#QuobyteHD',id=ee6d150f-4a24-46ca-9941-17cb6f3d5581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983c228d56446f59c226fe03cbba51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:26Z,use_quota=True,user_id='7d13e0038069456cbca2800fab900a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a3808b1-9565-4a96-94aa-15599c3d91a0),volume_type_id=7a3808b1-9565-4a96-94aa-15599c3d91a0)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Creating volume ee6d150f-4a24-46ca-9941-17cb6f3d5581 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:26 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:26 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 1073741824 Jul 21 17:20:26 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:26 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.347s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Deleted volume successfully. Jul 21 17:20:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9dc48172-61be-45d2-b1be-b200628e9d45 tempest-AttachVolumeNegativeTest-1288094069 None] Lock "cinder-e11ec965-2868-4e04-86e3-17647fa8cb04-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:26 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 1073741824" returned: 0 in 0.555s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:27 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 Jul 21 17:20:27 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:27 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581" returned: 0 in 0.339s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576fbc1a-42e5-4505-86b3-0a3fe3174d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86efad72-7221-4c26-a5eb-4d7c859f1f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=111,cinder:UPDATE=149,cinder:DELETE=7,cinder:INSERT=40 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:20:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Volume volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 (ee6d150f-4a24-46ca-9941-17cb6f3d5581): created successfully Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86efad72-7221-4c26-a5eb-4d7c859f1f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Flow 'volume_create_manager' (52d62b77-2a9f-492f-9cba-33aee7f285ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-09f3b9c8-2a77-43d1-873d-47fb51c6a5ab tempest-GroupsTest-645013563 None] Created volume successfully. Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Flow 'volume_create_manager' (e3152718-be98-40b6-b4a8-1e570e7e6bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41103f8-7047-41b9-b5cc-e7e55405c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41103f8-7047-41b9-b5cc-e7e55405c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1498467991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b04fd-1b3a-4a67-90a4-d7e93dd0f02d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8eb95e284b3348ec855af3b9d4501d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:28Z,use_quota=True,user_id='6361110061ab4d2dbbe9d8066875b6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e945b77d-c478-412a-afc4-81774b3f392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e945b77d-c478-412a-afc4-81774b3f392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855e29c2-962f-402c-8cf8-2a7f41feabdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855e29c2-962f-402c-8cf8-2a7f41feabdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999b04fd-1b3a-4a67-90a4-d7e93dd0f02d', 'volume_name': 'volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c911dbea-a65c-4ca3-b49c-1b4648521d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c911dbea-a65c-4ca3-b49c-1b4648521d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0991793-01a1-424e-aaa3-fd108a3588b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Volume 999b04fd-1b3a-4a67-90a4-d7e93dd0f02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d', 'volume_size': 1} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1498467991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b04fd-1b3a-4a67-90a4-d7e93dd0f02d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8eb95e284b3348ec855af3b9d4501d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:28Z,use_quota=True,user_id='6361110061ab4d2dbbe9d8066875b6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Creating volume 999b04fd-1b3a-4a67-90a4-d7e93dd0f02d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:27 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:27 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d 1073741824 Jul 21 17:20:27 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:28 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d 1073741824" returned: 0 in 0.499s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:28 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d Jul 21 17:20:28 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:28 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d" returned: 0 in 0.293s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0991793-01a1-424e-aaa3-fd108a3588b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e6a084-7be3-47d0-a8f3-3cc2a131054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Volume volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d (999b04fd-1b3a-4a67-90a4-d7e93dd0f02d): created successfully Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e6a084-7be3-47d0-a8f3-3cc2a131054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Flow 'volume_create_manager' (e3152718-be98-40b6-b4a8-1e570e7e6bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-e8d11ff3-1f52-4210-93ac-774028fef148 req-698f4abe-563f-4ef4-83ce-d735447461f7 tempest-VolumesGetTestJSON-608377997 None] Created volume successfully. Jul 21 17:20:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fdd59a18-c2b1-4b3c-b92b-ab2be337b672 tempest-GroupsTest-645013563 None] Update group completed successfully. Jul 21 17:20:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Acquiring lock "cinder-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Lock "cinder-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Acquiring lock "cinder-quobyte-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Lock "cinder-quobyte-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca09bc9-ab2b-44c4-b55b-7db74d46bd99]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:29 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d Jul 21 17:20:29 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:30 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d" returned: 0 in 0.500s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:30 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d Jul 21 17:20:30 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:30 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Lock "cinder-quobyte-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d" released by "delete_volume" :: held 0.876s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b2f7340f-e09f-4af0-87b0-0bb22227358c tempest-GroupsTest-645013563 None] Update group completed successfully. Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG cinder.quota [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Created reservations ['6dcfc920-6f6f-4f16-8f5a-7452b080048f', '6d13dc60-df05-4226-95a9-e7737e00307f', '31e106b2-1886-44a4-b655-2abf409d570f', '5cb6afe8-e141-4a95-b5a6-e2cc68a78b7f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:30 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:30 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:30 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.323s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:30 devstack cinder-volume[87591]: DEBUG cinder.manager [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Deleted volume successfully. Jul 21 17:20:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-4371973d-3db9-4543-83e6-d76f48ed4e0f req-2d91c6be-3bfa-4cf2-adc1-17ceaa7f2653 tempest-VolumesGetTestJSON-608377997 None] Lock "cinder-999b04fd-1b3a-4a67-90a4-d7e93dd0f02d-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Acquiring lock "cinder-quobyte-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Lock "cinder-quobyte-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f78a70b-1e20-42c5-b8a2-1997cd73677c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:32 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e Jul 21 17:20:32 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:32 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e" returned: 0 in 0.466s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:32 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e Jul 21 17:20:32 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:33 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e" returned: 0 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Lock "cinder-quobyte-57e01aa3-0d73-4ef0-ab38-35ec1ae9a06e" released by "delete_volume" :: held 0.935s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Acquiring lock "cinder-quobyte-ee6d150f-4a24-46ca-9941-17cb6f3d5581" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Lock "cinder-quobyte-ee6d150f-4a24-46ca-9941-17cb6f3d5581" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f740ab6-6aa5-47f8-a446-30ffd4388aee]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:33 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 Jul 21 17:20:33 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:33 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581" returned: 0 in 0.397s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:33 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581 Jul 21 17:20:33 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:34 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee6d150f-4a24-46ca-9941-17cb6f3d5581" returned: 0 in 0.286s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Lock "cinder-quobyte-ee6d150f-4a24-46ca-9941-17cb6f3d5581" released by "delete_volume" :: held 0.727s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Created reservations ['682d6397-5ec5-4ff3-baa5-c76de4a34ab5'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:34 devstack cinder-volume[87591]: WARNING cinder.quota [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1053051151 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1053051151, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:34 devstack cinder-volume[87591]: WARNING cinder.quota [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1053051151 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1053051151, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Created reservations ['4391c038-3e64-4be5-ad87-3a6f36567049', 'ce7392e7-8220-4098-b258-d7c69ab00851', '835f2438-1db7-4331-9313-815b9f92a6c3', 'c5d7b9c8-50b4-4b92-b706-1ab4e782d352'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Created reservations ['7b713ec0-a6aa-4b93-aba6-98d8a2f4ca1c', '64af60c6-bfe3-44e8-a5f5-06b4eebf2150', '8172e0c2-d566-488f-8c9c-d99512c3ebfd', 'd579f83a-a5c2-48e8-830e-41f9db7f61d7'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:34 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:34 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:34 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.262s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:34 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:34 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4b661225-122b-4bf3-a493-da17fd24b3a1 tempest-GroupsTest-645013563 None] Delete group completed successfully. Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Flow 'volume_create_manager' (dcaab9a4-df96-4fe0-9569-855b19314d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e584706-c25a-4e6b-89f4-55d5635866c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e584706-c25a-4e6b-89f4-55d5635866c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1175017282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791cd095-5182-4612-b0d9-a1ab8ad4feb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7d32d630024fc5b7cc158feca9cea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:35Z,use_quota=True,user_id='e59498b6bb9742cb9cfc47d9ee3bb1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac51ef88-9272-4b3f-9510-a3cc6c63c48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac51ef88-9272-4b3f-9510-a3cc6c63c48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fb78ba-560e-49b1-bd82-1f6cdb4e8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fb78ba-560e-49b1-bd82-1f6cdb4e8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791cd095-5182-4612-b0d9-a1ab8ad4feb9', 'volume_name': 'volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83daa0d2-456b-4318-825a-1aa8a4440492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83daa0d2-456b-4318-825a-1aa8a4440492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98d285f-bd26-4e60-ad4b-63563eecc5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Volume 791cd095-5182-4612-b0d9-a1ab8ad4feb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9', 'volume_size': 1} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1175017282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791cd095-5182-4612-b0d9-a1ab8ad4feb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7d32d630024fc5b7cc158feca9cea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:35Z,use_quota=True,user_id='e59498b6bb9742cb9cfc47d9ee3bb1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Creating volume 791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:35 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:35 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 1073741824 Jul 21 17:20:35 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:35 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 1073741824" returned: 0 in 0.481s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:36 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 Jul 21 17:20:36 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:36 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9" returned: 0 in 0.320s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98d285f-bd26-4e60-ad4b-63563eecc5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6053c873-d727-4991-b28e-29263191c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Volume volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 (791cd095-5182-4612-b0d9-a1ab8ad4feb9): created successfully Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6053c873-d727-4991-b28e-29263191c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Flow 'volume_create_manager' (dcaab9a4-df96-4fe0-9569-855b19314d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-472f7a89-6300-4ac4-b6ed-acb3bc77bd71 req-9cf8a83c-5ccb-42f9-aba3-c55b81fd70f1 tempest-VolumesSnapshotsTestJSON-1713250498 None] Created volume successfully. Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Creating offline snapshot 690ac710-ae1b-4376-ab3b-0a30b7acdfa3 of volume 791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8011885-3f30-4875-ba80-4633cc54097f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:37 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 Jul 21 17:20:37 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-791ce8ff-bdc7-4592-97ee-26b867b0359c tempest-GroupSnapshotsTest-445642441 None] Group tempest-GroupSnapshotsTest-Group-835689271: creating Jul 21 17:20:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-791ce8ff-bdc7-4592-97ee-26b867b0359c tempest-GroupSnapshotsTest-445642441 None] Group tempest-GroupSnapshotsTest-Group-835689271: created successfully Jul 21 17:20:37 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9" returned: 0 in 0.458s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-791ce8ff-bdc7-4592-97ee-26b867b0359c tempest-GroupSnapshotsTest-445642441 None] Create group completed successfully. Jul 21 17:20:37 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 1G Jul 21 17:20:37 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:38 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 1G" returned: 0 in 0.511s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:38 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 Jul 21 17:20:38 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:38 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:38 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 is being set with open permissions: ugo+rw Jul 21 17:20:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:38 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 Jul 21 17:20:38 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:38 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:38 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info Jul 21 17:20:38 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:39 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info" returned: 0 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:39 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info is being set with open permissions: ugo+rw Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:39 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info Jul 21 17:20:39 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:39 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (14b1e4b1-bbad-4729-bfbe-016640f2dd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a919ac30-49d4-41f3-9603-fde9c5059ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.info" returned: 0 in 0.333s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a919ac30-49d4-41f3-9603-fde9c5059ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1687145849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bb5cd10-197a-4ea7-b8fc-c87e8cfb5968,host='devstack@QuobyteHD#QuobyteHD',id=277ed5cd-0813-48ea-8273-e6cd44d0c207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:39Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(468f5286-4da5-41bd-bfac-b5d60373f9eb),volume_type_id=468f5286-4da5-41bd-bfac-b5d60373f9eb)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f25883-dbd4-4641-96df-a046b0479ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f25883-dbd4-4641-96df-a046b0479ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aa9351-7e68-478b-8b8c-e9031c0d9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aa9351-7e68-478b-8b8c-e9031c0d9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277ed5cd-0813-48ea-8273-e6cd44d0c207', 'volume_name': 'volume-277ed5cd-0813-48ea-8273-e6cd44d0c207', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24ca667-00ee-4dab-b44e-f03e3b20c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24ca667-00ee-4dab-b44e-f03e3b20c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d59188b-2bb9-4296-95f1-cb7b6040ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:39 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Volume 277ed5cd-0813-48ea-8273-e6cd44d0c207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277ed5cd-0813-48ea-8273-e6cd44d0c207', 'volume_size': 1} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bb5cd10-197a-4ea7-b8fc-c87e8cfb5968,created_at=2026-07-21T15:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1687145849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bb5cd10-197a-4ea7-b8fc-c87e8cfb5968,host='devstack@QuobyteHD#QuobyteHD',id=277ed5cd-0813-48ea-8273-e6cd44d0c207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:39Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(468f5286-4da5-41bd-bfac-b5d60373f9eb),volume_type_id=468f5286-4da5-41bd-bfac-b5d60373f9eb)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Creating volume 277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:39 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-2ddc5ea6-a65d-4f70-a3af-cf3d586008f7 req-1accb25f-0250-4601-a024-37c3d756afe4 tempest-VolumesSnapshotsTestJSON-1713250498 None] Create snapshot completed successfully Jul 21 17:20:39 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 1073741824 Jul 21 17:20:39 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "cinder-690ac710-ae1b-4376-ab3b-0a30b7acdfa3-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-690ac710-ae1b-4376-ab3b-0a30b7acdfa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "cinder-quobyte-791cd095-5182-4612-b0d9-a1ab8ad4feb9" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-quobyte-791cd095-5182-4612-b0d9-a1ab8ad4feb9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "cinder-quobyte-690ac710-ae1b-4376-ab3b-0a30b7acdfa3" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-quobyte-690ac710-ae1b-4376-ab3b-0a30b7acdfa3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Deleting offline snapshot 690ac710-ae1b-4376-ab3b-0a30b7acdfa3 of volume 791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] snapshot_file for this snap is: volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8458e46a-b74c-4ff9-8d20-ecd0406eafad]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:40 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 Jul 21 17:20:40 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:40 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 1073741824" returned: 0 in 0.614s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:40 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:40 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:40 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99236f6a-da8a-4d94-8577-d223c6fb6d70]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:40 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.302s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d59188b-2bb9-4296-95f1-cb7b6040ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277ed5cd-0813-48ea-8273-e6cd44d0c207', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034695d8-bb73-467a-99a6-b6e9b96396e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:40 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 Jul 21 17:20:40 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:40 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Volume volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 (277ed5cd-0813-48ea-8273-e6cd44d0c207): created successfully Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034695d8-bb73-467a-99a6-b6e9b96396e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (14b1e4b1-bbad-4729-bfbe-016640f2dd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1f8aa2c8-faea-45a8-8099-836b96f788d8 tempest-GroupSnapshotsTest-445642441 None] Created volume successfully. Jul 21 17:20:40 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:41 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 Jul 21 17:20:41 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] GroupSnapshot 635a7e17-3c0e-452f-a7af-cae287170a50: creating. Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Group snapshot 635a7e17-3c0e-452f-a7af-cae287170a50: creating. {{(pid=87591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Creating offline snapshot e8952b0a-fc8c-4d4e-8c14-4d463f213dbb of volume 277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964c348-96cd-4d84-af37-4d1cbe1ce23c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:41 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:41 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:41 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3" returned: 0 in 0.398s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:41 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3 Jul 21 17:20:41 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:41 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.440s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:41 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9.690ac710-ae1b-4376-ab3b-0a30b7acdfa3" returned: 0 in 0.282s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:41 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb 1G Jul 21 17:20:41 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-quobyte-690ac710-ae1b-4376-ab3b-0a30b7acdfa3" released by "_delete_snapshot" :: held 1.810s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-quobyte-791cd095-5182-4612-b0d9-a1ab8ad4feb9" released by "delete_snapshot" :: held 1.848s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f7c7f4ce-1df4-4e30-9724-25fa33309f28 tempest-GroupsV320Test-1826694587 None] Group tempest-GroupsV320Test-Group-1625450236: creating Jul 21 17:20:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f7c7f4ce-1df4-4e30-9724-25fa33309f28 tempest-GroupsV320Test-1826694587 None] Group tempest-GroupsV320Test-Group-1625450236: created successfully Jul 21 17:20:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f7c7f4ce-1df4-4e30-9724-25fa33309f28 tempest-GroupsV320Test-1826694587 None] Create group completed successfully. Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG cinder.quota [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Created reservations ['78e45ad4-8d59-4584-a666-a426bf2ff214', '2076aa67-c160-4d89-a061-683775b4d942', 'dd3b4c02-69a5-454f-bbcb-51c9de229d79', '633c9551-7313-4b4a-9f6b-848e56ca05b8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Delete snapshot completed successfully. Jul 21 17:20:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-66ed678b-15c1-4930-b9bc-a1a534496ddd req-052bc093-6144-45c3-b031-9a1e5832af97 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-690ac710-ae1b-4376-ab3b-0a30b7acdfa3-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:42 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:42 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:42 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb 1G" returned: 0 in 0.502s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:42 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb Jul 21 17:20:42 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "cinder-791cd095-5182-4612-b0d9-a1ab8ad4feb9-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-791cd095-5182-4612-b0d9-a1ab8ad4feb9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:42 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.327s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 8 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "cinder-quobyte-791cd095-5182-4612-b0d9-a1ab8ad4feb9" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-quobyte-791cd095-5182-4612-b0d9-a1ab8ad4feb9" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83a90fc-159d-40ec-93e2-ef4dfd118159]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:42 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" returned: 0 in 0.378s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:42 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:42 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb Jul 21 17:20:42 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:42 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 Jul 21 17:20:42 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:42 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:42 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9" returned: 0 in 0.404s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:42 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info Jul 21 17:20:42 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:42 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9 Jul 21 17:20:42 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:43 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:43 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:43 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-791cd095-5182-4612-b0d9-a1ab8ad4feb9" returned: 0 in 0.298s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:43 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info Jul 21 17:20:43 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-quobyte-791cd095-5182-4612-b0d9-a1ab8ad4feb9" released by "delete_volume" :: held 0.764s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.quota [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Created reservations ['b01fbe46-e10b-4205-b39a-27699cf1d841', '749748d8-ce13-40d1-a1a4-be51ef4382a9', 'dfe61343-402e-47e4-a9f3-193c814386f8', '892076b9-5c6a-4181-b4f1-bb429544a77c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:43 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:43 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Created reservations ['c20fffbb-7ca6-48e2-a594-e3aa65bd7b72'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:43 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.info" returned: 0 in 0.405s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:43 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:43 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:43 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.manager [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Deleted volume successfully. Jul 21 17:20:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d8d3b592-cf21-4b12-8324-d1ebcb379206 tempest-GroupSnapshotsTest-445642441 None] group_snapshot 635a7e17-3c0e-452f-a7af-cae287170a50: created successfully Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-547197db-f5e5-4d43-ad73-c295ec1047ec req-da4c455d-53c3-4912-8b66-231944a34e50 tempest-VolumesSnapshotsTestJSON-1713250498 None] Lock "cinder-791cd095-5182-4612-b0d9-a1ab8ad4feb9-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:43 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.287s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:43 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-77eace80-0481-4375-8458-569d1408fba2 tempest-GroupsV320Test-1826694587 None] Delete group completed successfully. Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-e8952b0a-fc8c-4d4e-8c14-4d463f213dbb-e58a9f27-2d55-498c-8fde-6cdaca925ec0" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e8952b0a-fc8c-4d4e-8c14-4d463f213dbb-e58a9f27-2d55-498c-8fde-6cdaca925ec0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Creating volume e58a9f27-2d55-498c-8fde-6cdaca925ec0 from snapshot e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-e58a9f27-2d55-498c-8fde-6cdaca925ec0" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e58a9f27-2d55-498c-8fde-6cdaca925ec0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] snapshot: e8952b0a-fc8c-4d4e-8c14-4d463f213dbb, volume: e58a9f27-2d55-498c-8fde-6cdaca925ec0, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfc464-41a3-45ac-973e-23a7ae50e79c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:45 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb Jul 21 17:20:45 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:45 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" returned: 0 in 0.530s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-277ed5cd-0813-48ea-8273-e6cd44d0c207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a851e-78af-4bda-b371-901ec51c963e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:46 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:46 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:46 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.469s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:46 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:20:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:46 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 Jul 21 17:20:46 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-95506549-bc2e-4da7-8a73-1fa284a502eb tempest-BackendsCapabilitiesAdminTestsJSON-2050056842 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 17:20:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cb1fe1de-888b-48ff-b739-157b52895324 tempest-BackendsCapabilitiesAdminTestsJSON-2050056842 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 17:20:52 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0" returned: 0 in 6.051s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:52 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0f67e-59e1-495b-affd-6dcec9634723]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:52 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:52 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:53 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.678s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:20:53 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Converted 1024.00 MB image at 169.20 MB/s Jul 21 17:20:53 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:53 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 Jul 21 17:20:53 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Flow 'volume_create_manager' (1325c1cd-3c28-439d-a494-91834c9aeb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3593443-a47a-4ef7-9458-e9954f7b28e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3593443-a47a-4ef7-9458-e9954f7b28e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1710086415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff2da40-6115-4338-a2f4-8772c0657837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='549ce94bdd4749aab0506d8e667a4efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:53Z,use_quota=True,user_id='4ec5ca80ea1343ab8ee593ff93647d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bfd7bd-41d5-45da-b88b-c83642082271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bfd7bd-41d5-45da-b88b-c83642082271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01317f9-bcf2-4a91-9914-ac8b4e42bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01317f9-bcf2-4a91-9914-ac8b4e42bf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff2da40-6115-4338-a2f4-8772c0657837', 'volume_name': 'volume-0ff2da40-6115-4338-a2f4-8772c0657837', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:53 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed68e96-ff55-486a-87de-bbb4f16c523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed68e96-ff55-486a-87de-bbb4f16c523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c9ebb5-2f31-4aea-8b79-62b919b806a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Volume 0ff2da40-6115-4338-a2f4-8772c0657837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff2da40-6115-4338-a2f4-8772c0657837', 'volume_size': 1} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0" returned: 0 in 0.327s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e58a9f27-2d55-498c-8fde-6cdaca925ec0" released by "_copy_volume_from_snapshot" :: held 8.206s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e8952b0a-fc8c-4d4e-8c14-4d463f213dbb-e58a9f27-2d55-498c-8fde-6cdaca925ec0" released by "_create_volume_from_snapshot" :: held 8.245s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.265s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1710086415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff2da40-6115-4338-a2f4-8772c0657837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='549ce94bdd4749aab0506d8e667a4efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:53Z,use_quota=True,user_id='4ec5ca80ea1343ab8ee593ff93647d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Creating volume 0ff2da40-6115-4338-a2f4-8772c0657837 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:53 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:53 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 1073741824 Jul 21 17:20:53 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-84c8f28d-9149-40a2-8bdb-3fa8f8a9c4dc tempest-GroupSnapshotsTest-445642441 None] Create group from source-snapshot-635a7e17-3c0e-452f-a7af-cae287170a50 completed successfully. Jul 21 17:20:54 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 1073741824" returned: 0 in 0.548s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:54 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 Jul 21 17:20:54 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:54 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837" returned: 0 in 0.369s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c9ebb5-2f31-4aea-8b79-62b919b806a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff2da40-6115-4338-a2f4-8772c0657837', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a249a51-c3eb-4d5f-ae02-5cd51bdcbe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Volume volume-0ff2da40-6115-4338-a2f4-8772c0657837 (0ff2da40-6115-4338-a2f4-8772c0657837): created successfully Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a249a51-c3eb-4d5f-ae02-5cd51bdcbe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Flow 'volume_create_manager' (1325c1cd-3c28-439d-a494-91834c9aeb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-89d0f430-2442-496c-bde1-dc4e4456957a tempest-VolumesListTestJSON-1436715106 None] Created volume successfully. Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-e58a9f27-2d55-498c-8fde-6cdaca925ec0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e58a9f27-2d55-498c-8fde-6cdaca925ec0" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3040ef-bda0-4ba5-9409-d94f9d8e9987]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:54 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 Jul 21 17:20:54 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:55 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:55 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0 Jul 21 17:20:55 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:55 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e58a9f27-2d55-498c-8fde-6cdaca925ec0" returned: 0 in 0.270s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e58a9f27-2d55-498c-8fde-6cdaca925ec0" released by "delete_volume" :: held 0.754s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['f262606e-b73c-48d2-adf4-c4338ebf1dd5'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:55 devstack cinder-volume[87591]: WARNING cinder.quota [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-254254848 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-254254848, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:55 devstack cinder-volume[87591]: WARNING cinder.quota [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-254254848 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-254254848, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['60daf716-ea02-4541-805f-05fc9b1bc85a', '56658040-1033-4281-ba0f-ca02514a1093', '63fec1be-25af-4053-a1e5-a2bb8c1dcc9e', 'fc0753bc-e0da-4e13-949a-efcfa81c9c64'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:55 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:55 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:55 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.299s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:20:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a5e47f85-593a-4ed7-ba76-ba807100e1c1 tempest-GroupSnapshotsTest-445642441 None] Delete group completed successfully. Jul 21 17:20:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] group_snapshot 635a7e17-3c0e-452f-a7af-cae287170a50: deleting Jul 21 17:20:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] group_snapshot 635a7e17-3c0e-452f-a7af-cae287170a50: deleting {{(pid=87591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-277ed5cd-0813-48ea-8273-e6cd44d0c207" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-277ed5cd-0813-48ea-8273-e6cd44d0c207" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Deleting offline snapshot e8952b0a-fc8c-4d4e-8c14-4d463f213dbb of volume 277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] snapshot_file for this snap is: volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b736aac-daf7-4e95-aa8e-3f84dd755f51]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Flow 'volume_create_manager' (83467220-12fa-4d70-9b22-b4584a51fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a051682-d819-45bd-81e5-fbb69f0a182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a051682-d819-45bd-81e5-fbb69f0a182b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2053583103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abedf39-6d4a-4e99-b516-42b00c7e0ff7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='549ce94bdd4749aab0506d8e667a4efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:56Z,use_quota=True,user_id='4ec5ca80ea1343ab8ee593ff93647d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:56 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb Jul 21 17:20:56 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf3d8d3-43a6-4e30-92c2-04aacc48699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf3d8d3-43a6-4e30-92c2-04aacc48699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a76b6e-9942-4d27-890e-335be29cc76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a76b6e-9942-4d27-890e-335be29cc76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abedf39-6d4a-4e99-b516-42b00c7e0ff7', 'volume_name': 'volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92d52ad-c1b6-49d0-8c57-88b1e43e65ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92d52ad-c1b6-49d0-8c57-88b1e43e65ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5363032-c031-494b-9dfc-430badc5c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:56 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Volume 4abedf39-6d4a-4e99-b516-42b00c7e0ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7', 'volume_size': 1} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2053583103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abedf39-6d4a-4e99-b516-42b00c7e0ff7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='549ce94bdd4749aab0506d8e667a4efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:56Z,use_quota=True,user_id='4ec5ca80ea1343ab8ee593ff93647d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Creating volume 4abedf39-6d4a-4e99-b516-42b00c7e0ff7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:56 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:56 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 1073741824 Jul 21 17:20:56 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:56 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" returned: 0 in 0.492s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-277ed5cd-0813-48ea-8273-e6cd44d0c207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caca5b3-4793-41ec-ab70-0697757361b4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:56 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:56 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:56 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 1073741824" returned: 0 in 0.533s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:57 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 Jul 21 17:20:57 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:57 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.451s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:57 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb Jul 21 17:20:57 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:57 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7" returned: 0 in 0.321s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5363032-c031-494b-9dfc-430badc5c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560bb017-a384-45fd-920c-656297353efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Volume volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 (4abedf39-6d4a-4e99-b516-42b00c7e0ff7): created successfully Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560bb017-a384-45fd-920c-656297353efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Flow 'volume_create_manager' (83467220-12fa-4d70-9b22-b4584a51fa80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f97cf28d-4696-47fa-adfa-147f688a3940 tempest-VolumesListTestJSON-1436715106 None] Created volume successfully. Jul 21 17:20:57 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" returned: 0 in 0.396s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:57 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb Jul 21 17:20:57 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:57 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207.e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-e8952b0a-fc8c-4d4e-8c14-4d463f213dbb" released by "_delete_snapshot" :: held 1.744s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-277ed5cd-0813-48ea-8273-e6cd44d0c207" released by "delete_snapshot" :: held 1.780s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:57 devstack cinder-volume[87591]: WARNING cinder.quota [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-254254848 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-254254848, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:20:57 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] Created reservations ['7d5b359c-a22c-4b3e-ae53-e4aee50052fc', '623004a0-f908-4bc7-9826-c4f6b95f993f', 'ccaad8ea-72a2-4dc2-9ec9-e2726c959f80', '0771e459-3b55-4ff1-9343-0e949b245f4d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b700a340-8e60-4f8a-89ac-cfb41441f90b tempest-GroupSnapshotsTest-445642441 None] group_snapshot 635a7e17-3c0e-452f-a7af-cae287170a50: deleted successfully Jul 21 17:20:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-277ed5cd-0813-48ea-8273-e6cd44d0c207" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:20:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-277ed5cd-0813-48ea-8273-e6cd44d0c207" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:20:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd11bdeb-1158-4674-878f-78efbf525979]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:20:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:58 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:58 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Flow 'volume_create_manager' (1ce01029-8944-4785-b98f-ac01fc501d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a551ad-88df-4fb6-b3bd-68555aa9eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a551ad-88df-4fb6-b3bd-68555aa9eda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-805755089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='549ce94bdd4749aab0506d8e667a4efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:59Z,use_quota=True,user_id='4ec5ca80ea1343ab8ee593ff93647d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9d66d5-03af-45b8-a92e-f7f2905959d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9d66d5-03af-45b8-a92e-f7f2905959d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28f66c0-72b6-474f-a4f8-bb0d7b97d14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28f66c0-72b6-474f-a4f8-bb0d7b97d14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f', 'volume_name': 'volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df1558c-cd72-4c62-83c9-b1e5bc922126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df1558c-cd72-4c62-83c9-b1e5bc922126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292f14d8-b79d-4c02-a7c7-a2304bcacade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:20:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Volume f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f', 'volume_size': 1} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-805755089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='549ce94bdd4749aab0506d8e667a4efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:20:59Z,use_quota=True,user_id='4ec5ca80ea1343ab8ee593ff93647d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Creating volume f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:20:59 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:59 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f 1073741824 Jul 21 17:20:59 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:59 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.422s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:59 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207 Jul 21 17:20:59 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:59 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-277ed5cd-0813-48ea-8273-e6cd44d0c207" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-277ed5cd-0813-48ea-8273-e6cd44d0c207" released by "delete_volume" :: held 0.893s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:20:59 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f 1073741824" returned: 0 in 0.521s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Created reservations ['752541d5-d6b6-4300-83d6-010c02c7e797'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:59 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f Jul 21 17:20:59 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:20:59 devstack cinder-volume[87591]: WARNING cinder.db.api [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-254254848'] Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Created reservations ['10c9027e-e261-46a3-b1ce-c44ac68c76d4', 'cf4f0974-1f1b-41e6-a70e-eb1ff50f9167', '6674d27d-0c44-4254-963f-46fe651095e5', 'c8bafe59-a5b4-4e2e-93a0-682b1330b4e6'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:20:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:20:59 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:20:59 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:00 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f" returned: 0 in 0.415s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292f14d8-b79d-4c02-a7c7-a2304bcacade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11754b-7b12-4e9a-b5ab-8a9ecb91a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:00 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Volume volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f (f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f): created successfully Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11754b-7b12-4e9a-b5ab-8a9ecb91a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Flow 'volume_create_manager' (1ce01029-8944-4785-b98f-ac01fc501d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-43016b3d-6a7b-4d5a-8aa0-edcd06a05e6e tempest-VolumesListTestJSON-1436715106 None] Created volume successfully. Jul 21 17:21:00 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.351s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:00 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d8f5c178-f2d6-4f41-8f35-71a4596b0ede tempest-GroupSnapshotsTest-445642441 None] Delete group completed successfully. Jul 21 17:21:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-10c210fd-2463-4333-8963-932d539c11b7 tempest-GroupSnapshotsTest-445642441 None] Group tempest-GroupSnapshotsTest-Group-963971164: creating Jul 21 17:21:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-10c210fd-2463-4333-8963-932d539c11b7 tempest-GroupSnapshotsTest-445642441 None] Group tempest-GroupSnapshotsTest-Group-963971164: created successfully Jul 21 17:21:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-10c210fd-2463-4333-8963-932d539c11b7 tempest-GroupSnapshotsTest-445642441 None] Create group completed successfully. Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (40d3f174-b40e-4ee7-9c4e-876f8d9f7db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6854813b-c18d-4d8f-9b2c-e10023319497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6854813b-c18d-4d8f-9b2c-e10023319497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1145936689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd574180-b0e0-4e35-83f8-17acdc2f6ac4,host='devstack@QuobyteHD#QuobyteHD',id=027f6fcd-bda1-4d45-96e7-182915a2a932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:02Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43293fff-722a-449a-81df-af84b0213830),volume_type_id=43293fff-722a-449a-81df-af84b0213830)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd72cbe-00b4-4e6f-8191-25343f23d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd72cbe-00b4-4e6f-8191-25343f23d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8a5a7e-94e4-4c5b-a29b-03d5accc7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8a5a7e-94e4-4c5b-a29b-03d5accc7811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027f6fcd-bda1-4d45-96e7-182915a2a932', 'volume_name': 'volume-027f6fcd-bda1-4d45-96e7-182915a2a932', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad60995-a683-4541-9edd-7ae01420de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad60995-a683-4541-9edd-7ae01420de49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12f397-74e8-4544-ab8c-4d14bd72bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:02 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Volume 027f6fcd-bda1-4d45-96e7-182915a2a932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027f6fcd-bda1-4d45-96e7-182915a2a932', 'volume_size': 1} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd574180-b0e0-4e35-83f8-17acdc2f6ac4,created_at=2026-07-21T15:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1145936689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd574180-b0e0-4e35-83f8-17acdc2f6ac4,host='devstack@QuobyteHD#QuobyteHD',id=027f6fcd-bda1-4d45-96e7-182915a2a932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:02Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43293fff-722a-449a-81df-af84b0213830),volume_type_id=43293fff-722a-449a-81df-af84b0213830)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Creating volume 027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:02 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:02 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 1073741824 Jul 21 17:21:02 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:03 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 1073741824" returned: 0 in 0.553s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:03 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 Jul 21 17:21:03 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "cinder-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "cinder-quobyte-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-quobyte-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[92086f23-99ff-459b-b75a-4593e147dc2d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:03 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932" returned: 0 in 0.378s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12f397-74e8-4544-ab8c-4d14bd72bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027f6fcd-bda1-4d45-96e7-182915a2a932', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:03 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f Jul 21 17:21:03 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecb6d5-51db-4659-b723-b6905e2fbbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Volume volume-027f6fcd-bda1-4d45-96e7-182915a2a932 (027f6fcd-bda1-4d45-96e7-182915a2a932): created successfully Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecb6d5-51db-4659-b723-b6905e2fbbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (40d3f174-b40e-4ee7-9c4e-876f8d9f7db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-47ad07aa-6c5d-44ed-86d6-74ee419540e5 tempest-GroupSnapshotsTest-445642441 None] Created volume successfully. Jul 21 17:21:03 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f" returned: 0 in 0.412s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:03 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f Jul 21 17:21:03 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:04 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-quobyte-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f" released by "delete_volume" :: held 0.723s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Created reservations ['d2a1fdef-5987-4fff-8f63-3c53d836f8eb', '58f9b752-6e0f-46d8-b9b1-06a101fac750', 'ef337341-d6fa-415f-affb-97660a5bd7c6', '0c66923a-84b7-43a6-89f9-c8004eb8d128'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:04 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:04 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:04 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.288s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:04 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Deleted volume successfully. Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "cinder-4abedf39-6d4a-4e99-b516-42b00c7e0ff7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-4abedf39-6d4a-4e99-b516-42b00c7e0ff7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62743059-3f08-486f-8ef4-0c12547ee954 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-f871d4c3-34c6-4e5f-b3c1-c80d52fdbc9f-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "cinder-quobyte-4abedf39-6d4a-4e99-b516-42b00c7e0ff7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-quobyte-4abedf39-6d4a-4e99-b516-42b00c7e0ff7" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f764d0c-4996-4e46-868b-16d3bdd9e4b6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:04 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 Jul 21 17:21:04 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:05 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7" returned: 0 in 0.509s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:05 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7 Jul 21 17:21:05 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Flow 'volume_create_manager' (007cea40-bc50-4b82-92bc-02f85cb2bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b83f71c-3b96-47d3-9330-3ad66f990d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b83f71c-3b96-47d3-9330-3ad66f990d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-558832766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bdba27-8c66-406f-a4aa-d111874764a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876b03dcc13048d68208b80a0bcf7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:05Z,use_quota=True,user_id='075fecf505f94f858ddacff346640fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f876c1dd-51c0-461b-a58c-5a82831e7d76),volume_type_id=f876c1dd-51c0-461b-a58c-5a82831e7d76)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa425a0a-96fc-4c97-b82d-9740f72cf7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa425a0a-96fc-4c97-b82d-9740f72cf7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d935cbe3-d5d6-438e-bf28-c4208797e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d935cbe3-d5d6-438e-bf28-c4208797e11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bdba27-8c66-406f-a4aa-d111874764a7', 'volume_name': 'volume-61bdba27-8c66-406f-a4aa-d111874764a7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d371085-003c-43ea-b87f-0cc71621fe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d371085-003c-43ea-b87f-0cc71621fe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b637eee-d2b7-4060-9d38-93f7bd7f6910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Volume 61bdba27-8c66-406f-a4aa-d111874764a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bdba27-8c66-406f-a4aa-d111874764a7', 'volume_size': 1} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-558832766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bdba27-8c66-406f-a4aa-d111874764a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876b03dcc13048d68208b80a0bcf7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:05Z,use_quota=True,user_id='075fecf505f94f858ddacff346640fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f876c1dd-51c0-461b-a58c-5a82831e7d76),volume_type_id=f876c1dd-51c0-461b-a58c-5a82831e7d76)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Creating volume 61bdba27-8c66-406f-a4aa-d111874764a7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:05 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:05 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 1073741824 Jul 21 17:21:05 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (2b3d5d61-f9a7-430b-8a46-f2c94d6c9fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b191d4-f768-45d8-90f4-a9445d2c4be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b191d4-f768-45d8-90f4-a9445d2c4be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308372635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd574180-b0e0-4e35-83f8-17acdc2f6ac4,host='devstack@QuobyteHD#QuobyteHD',id=536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:06Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43293fff-722a-449a-81df-af84b0213830),volume_type_id=43293fff-722a-449a-81df-af84b0213830)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296c6994-5c82-4b67-afcc-ab4f4ab16672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296c6994-5c82-4b67-afcc-ab4f4ab16672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dddfb1-2367-40b7-b9d3-86f96d154e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dddfb1-2367-40b7-b9d3-86f96d154e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa', 'volume_name': 'volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e3a85f-72e0-489d-9377-791af18be861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e3a85f-72e0-489d-9377-791af18be861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb23edd1-2773-46e5-b68e-d5d3a6febc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Volume 536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa', 'volume_size': 1} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4abedf39-6d4a-4e99-b516-42b00c7e0ff7" returned: 0 in 0.424s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-quobyte-4abedf39-6d4a-4e99-b516-42b00c7e0ff7" released by "delete_volume" :: held 0.990s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Created reservations ['fd67e7ea-ab81-4484-af48-38cc2ec85a1f', 'efa59745-25af-4c82-a278-2690d712837a', '07573d0a-d40a-4a99-b0d7-35055917e52a', '50add5b9-ed82-404d-9a94-f04ca8af757a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:05 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:05 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:06 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 1073741824" returned: 0 in 0.597s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:06 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 Jul 21 17:21:06 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:06 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Deleted volume successfully. Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8094781f-c148-4723-b9e1-811edc176752 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-4abedf39-6d4a-4e99-b516-42b00c7e0ff7-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:06 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7" returned: 0 in 0.288s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd574180-b0e0-4e35-83f8-17acdc2f6ac4,created_at=2026-07-21T15:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308372635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd574180-b0e0-4e35-83f8-17acdc2f6ac4,host='devstack@QuobyteHD#QuobyteHD',id=536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:06Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43293fff-722a-449a-81df-af84b0213830),volume_type_id=43293fff-722a-449a-81df-af84b0213830)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Creating volume 536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:06 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b637eee-d2b7-4060-9d38-93f7bd7f6910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bdba27-8c66-406f-a4aa-d111874764a7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f752a40d-8fd6-4110-ad21-57ff2dcd7372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:06 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa 1073741824 Jul 21 17:21:06 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:06 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Volume volume-61bdba27-8c66-406f-a4aa-d111874764a7 (61bdba27-8c66-406f-a4aa-d111874764a7): created successfully Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f752a40d-8fd6-4110-ad21-57ff2dcd7372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Flow 'volume_create_manager' (007cea40-bc50-4b82-92bc-02f85cb2bfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e1452570-0368-4eb7-b82b-93e71192b0ae tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Created volume successfully. Jul 21 17:21:06 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa 1073741824" returned: 0 in 0.470s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:06 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa Jul 21 17:21:06 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "cinder-0ff2da40-6115-4338-a2f4-8772c0657837-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-0ff2da40-6115-4338-a2f4-8772c0657837-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "cinder-quobyte-0ff2da40-6115-4338-a2f4-8772c0657837" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-quobyte-0ff2da40-6115-4338-a2f4-8772c0657837" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[85abd3d4-b378-4cb6-936c-cd29617560c1]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:07 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" returned: 0 in 0.321s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb23edd1-2773-46e5-b68e-d5d3a6febc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce7edba-bd6e-40fc-b88c-0a853894caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:07 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Volume volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa (536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa): created successfully Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce7edba-bd6e-40fc-b88c-0a853894caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (2b3d5d61-f9a7-430b-8a46-f2c94d6c9fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:07 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5a8f90c8-d857-4fa8-a6ce-ce948e01bfa8 tempest-GroupSnapshotsTest-445642441 None] Created volume successfully. Jul 21 17:21:07 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 Jul 21 17:21:07 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:07 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837" returned: 0 in 0.410s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:07 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837 Jul 21 17:21:07 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:07 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:07 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:07 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0ff2da40-6115-4338-a2f4-8772c0657837" returned: 0 in 0.290s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-quobyte-0ff2da40-6115-4338-a2f4-8772c0657837" released by "delete_volume" :: held 0.759s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:07 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Created reservations ['79e88102-921c-42cb-9138-340199145ea3', 'a4b32529-39f4-4315-a20f-e25a10f3bc21', '6492d80f-268b-4660-8e81-02092d20cc8d', '96317f74-b93d-4356-ba1d-e2bea00b525f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:08 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.322s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-928c079a-8087-4b4d-9b78-a17759558371 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Retype volume completed successfully. Jul 21 17:21:08 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:08 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-98384399-02ca-477e-968d-40faadedaf74 tempest-GroupSnapshotsTest-445642441 None] Update group completed successfully. Jul 21 17:21:08 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Deleted volume successfully. Jul 21 17:21:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eba8a6ad-157f-4435-809f-4915ac54a617 tempest-VolumesListTestJSON-1436715106 None] Lock "cinder-0ff2da40-6115-4338-a2f4-8772c0657837-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Acquiring lock "cinder-61bdba27-8c66-406f-a4aa-d111874764a7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "cinder-61bdba27-8c66-406f-a4aa-d111874764a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Acquiring lock "cinder-quobyte-61bdba27-8c66-406f-a4aa-d111874764a7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "cinder-quobyte-61bdba27-8c66-406f-a4aa-d111874764a7" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[921f5824-8750-4c1e-b918-b86916259614]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:09 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 Jul 21 17:21:09 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:09 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4ff19ea3-63ac-4ac0-9a73-c3447fdd9a28 tempest-GroupSnapshotsTest-445642441 None] Update group completed successfully. Jul 21 17:21:09 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7" returned: 0 in 0.470s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:09 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7 Jul 21 17:21:09 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:09 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-61bdba27-8c66-406f-a4aa-d111874764a7" returned: 0 in 0.270s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "cinder-quobyte-61bdba27-8c66-406f-a4aa-d111874764a7" released by "delete_volume" :: held 0.791s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:09 devstack cinder-volume[87591]: WARNING cinder.quota [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:09 devstack cinder-volume[87591]: WARNING cinder.quota [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:09 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Created reservations ['f841006a-2e1c-4c72-ba28-9e94a7d758a8', '63c4a915-5dab-44ff-92f4-c22a9b71e48a', 'ad8d3456-a630-4130-9ea4-a8ee01cac9df', '678b71cf-e48f-4e02-9c73-a0dc455940c4'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:10 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:10 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:10 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.297s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Deleted volume successfully. Jul 21 17:21:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37c0deef-34d4-464d-b5c4-ed806a497ce8 tempest-VolumeRetypeWithoutMigrationTest-1989914294 None] Lock "cinder-61bdba27-8c66-406f-a4aa-d111874764a7-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3f58fe44-14fe-4ba7-914f-41a9e62607d6 tempest-GroupSnapshotsTest-445642441 None] Update group completed successfully. Jul 21 17:21:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ef9d4a18-e311-40f7-90cb-9afa8c01ba89 tempest-GroupSnapshotsTest-445642441 None] Update group completed successfully. Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Flow 'volume_create_manager' (650d22ee-655e-4784-afb7-49a5aff17f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2558c563-f784-46e5-98e9-422ac0e42b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2558c563-f784-46e5-98e9-422ac0e42b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1326338812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f1b213-5607-4c9d-8deb-e1942ef6ce92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a24e3049d12494fa600ccda51488785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:12Z,use_quota=True,user_id='7afb973478cf4e4fa07cb100cbf3cf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ff4fd1-73ab-44a3-bab3-aac5bc49a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ff4fd1-73ab-44a3-bab3-aac5bc49a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66ed422-f3a3-41b6-8e45-f4e9d3d2eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66ed422-f3a3-41b6-8e45-f4e9d3d2eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f1b213-5607-4c9d-8deb-e1942ef6ce92', 'volume_name': 'volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92', 'volume_size': 2}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2f5e2a-33f5-40ff-8ff4-4d324462d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2f5e2a-33f5-40ff-8ff4-4d324462d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cecac46-6f09-43c1-926f-832c05ee2fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Volume 59f1b213-5607-4c9d-8deb-e1942ef6ce92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92', 'volume_size': 2} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1326338812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f1b213-5607-4c9d-8deb-e1942ef6ce92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a24e3049d12494fa600ccda51488785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:12Z,use_quota=True,user_id='7afb973478cf4e4fa07cb100cbf3cf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Creating volume 59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:12 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 2147483648 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:12 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 2147483648 Jul 21 17:21:12 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:12 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 2147483648" returned: 0 in 0.574s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:12 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 Jul 21 17:21:12 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:13 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cecac46-6f09-43c1-926f-832c05ee2fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92', 'volume_size': 2}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be02423-bc86-4227-b454-4958465855ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Volume volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 (59f1b213-5607-4c9d-8deb-e1942ef6ce92): created successfully Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be02423-bc86-4227-b454-4958465855ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Flow 'volume_create_manager' (650d22ee-655e-4784-afb7-49a5aff17f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a01df057-a229-442b-b993-e24acb2451f8 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Created volume successfully. Jul 21 17:21:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] GroupSnapshot 45b036ce-280e-49f3-846d-22b81aa7b09c: creating. Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Group snapshot 45b036ce-280e-49f3-846d-22b81aa7b09c: creating. {{(pid=87591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Creating offline snapshot 0ebfd5f6-c73e-4950-a386-4fd2969c6804 of volume 536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[293e1fa6-706c-4eda-9976-9c29353330a7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:13 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa Jul 21 17:21:13 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:14 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" returned: 0 in 0.427s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:14 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 1G Jul 21 17:21:14 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=189,cinder:INSERT=45,cinder:UPDATE=214,cinder:DELETE=15 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:14 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 1G" returned: 0 in 0.483s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:14 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 Jul 21 17:21:14 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:14 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804" returned: 0 in 0.324s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:14 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:21:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:14 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 Jul 21 17:21:14 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:15 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:15 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info Jul 21 17:21:15 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Flow 'volume_create_manager' (a79178e5-fc29-46b8-8ccd-fabe8a1f8ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ced82a-efda-4119-abb0-4b94cfde0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ced82a-efda-4119-abb0-4b94cfde0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1129630707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071f84bc-65c4-472c-b91f-2cef91115974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f834a01b0234481a653bc5fc658d670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:15Z,use_quota=True,user_id='8394bb4c6a014df482c10f465bb4deef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e536802-ae4d-48da-b43b-f5b972114aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e536802-ae4d-48da-b43b-f5b972114aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1436f5a8-4a58-48dd-8750-5c1852825e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1436f5a8-4a58-48dd-8750-5c1852825e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071f84bc-65c4-472c-b91f-2cef91115974', 'volume_name': 'volume-071f84bc-65c4-472c-b91f-2cef91115974', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64813db-3dd5-4213-a8c5-be25ba299082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64813db-3dd5-4213-a8c5-be25ba299082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603f169-a038-438f-b83f-5e4ccc6f3c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Volume 071f84bc-65c4-472c-b91f-2cef91115974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071f84bc-65c4-472c-b91f-2cef91115974', 'volume_size': 1} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:15 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info" returned: 0 in 0.255s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:15 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:15 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info Jul 21 17:21:15 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:15 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.info" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Creating offline snapshot ac093381-b06f-4ff7-94c1-9ea7dca15b42 of volume 027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aad77b-9b10-4449-96a9-63b01d010ce4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:15 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 Jul 21 17:21:15 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:16 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932" returned: 0 in 0.379s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:16 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 1G Jul 21 17:21:16 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:16 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 1G" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027f6fcd-bda1-4d45-96e7-182915a2a932 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:16 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027f6fcd-bda1-4d45-96e7-182915a2a932 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 Jul 21 17:21:16 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Flow 'volume_create_manager' (c65bad89-1dbe-4c6c-ac6b-3fb98e5fbdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b777c4f-ebaf-4165-a01c-65868d25adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b777c4f-ebaf-4165-a01c-65868d25adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-547748389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c598bf-7d36-4b68-89ef-a8fba440a4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fb74341c47406485305df042e90f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:17Z,use_quota=True,user_id='f926816d7b1b4fb0b679f73da31346b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fe2b39-b9fc-4adf-b03d-dfe14aa99109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fe2b39-b9fc-4adf-b03d-dfe14aa99109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d11053-0f9e-4a37-a660-2b71dca57ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d11053-0f9e-4a37-a660-2b71dca57ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c598bf-7d36-4b68-89ef-a8fba440a4d7', 'volume_name': 'volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712ccab6-a318-44ba-9e16-e3ce00e4d75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712ccab6-a318-44ba-9e16-e3ce00e4d75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db5660a-db0a-4a04-8573-260bcfd24c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Volume f4c598bf-7d36-4b68-89ef-a8fba440a4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7', 'volume_size': 1} Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:16 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027f6fcd-bda1-4d45-96e7-182915a2a932 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42" returned: 0 in 0.290s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:16 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:21:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:16 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 Jul 21 17:21:16 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:17 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42" returned: 0 in 0.259s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:17 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info Jul 21 17:21:17 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:17 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info" returned: 0 in 0.246s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:17 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:17 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info Jul 21 17:21:17 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:17 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.info" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1129630707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071f84bc-65c4-472c-b91f-2cef91115974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f834a01b0234481a653bc5fc658d670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:15Z,use_quota=True,user_id='8394bb4c6a014df482c10f465bb4deef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Creating volume 071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:17 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:17 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 1073741824 Jul 21 17:21:17 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-14df6e2f-a00c-43ce-bf56-ac2e7505a989 tempest-GroupSnapshotsTest-445642441 None] group_snapshot 45b036ce-280e-49f3-846d-22b81aa7b09c: created successfully Jul 21 17:21:18 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 1073741824" returned: 0 in 0.398s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:18 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 Jul 21 17:21:18 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:18 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.150s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603f169-a038-438f-b83f-5e4ccc6f3c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071f84bc-65c4-472c-b91f-2cef91115974', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36895e98-67a7-4491-8ea1-4c02b3d880b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Creating offline snapshot a8e68827-7027-46c1-b952-e126c1f510b6 of volume 59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Volume volume-071f84bc-65c4-472c-b91f-2cef91115974 (071f84bc-65c4-472c-b91f-2cef91115974): created successfully Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36895e98-67a7-4491-8ea1-4c02b3d880b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Flow 'volume_create_manager' (a79178e5-fc29-46b8-8ccd-fabe8a1f8ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3a6a0-2cdd-48ef-b4fe-ca3e6f72b2d5]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1ac1deb7-2510-4de1-9d07-da861a313f48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Created volume successfully. Jul 21 17:21:18 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 Jul 21 17:21:18 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:18 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92" returned: 0 in 0.357s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 2G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:18 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 2G Jul 21 17:21:18 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] group_snapshot 45b036ce-280e-49f3-846d-22b81aa7b09c: deleting Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] group_snapshot 45b036ce-280e-49f3-846d-22b81aa7b09c: deleting {{(pid=87591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-0ebfd5f6-c73e-4950-a386-4fd2969c6804" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-0ebfd5f6-c73e-4950-a386-4fd2969c6804" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Deleting offline snapshot 0ebfd5f6-c73e-4950-a386-4fd2969c6804 of volume 536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] snapshot_file for this snap is: volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c676b5d9-676f-4bf0-8aad-bf8edbc9c5e2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:19 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 Jul 21 17:21:19 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:19 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 2G" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:19 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 Jul 21 17:21:19 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:19 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804" returned: 0 in 0.433s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:21:19 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6" returned: 0 in 0.334s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:19 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 is being set with open permissions: ugo+rw Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[165d8b73-f0e6-4f58-bac3-d1875f09801b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:19 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 Jul 21 17:21:19 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:19 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa Jul 21 17:21:19 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:19 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6" returned: 0 in 0.248s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:19 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info Jul 21 17:21:19 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:20 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" returned: 0 in 0.377s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:20 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 Jul 21 17:21:20 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:20 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:20 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info is being set with open permissions: ugo+rw Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:20 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info Jul 21 17:21:20 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:20 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:20 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804 Jul 21 17:21:20 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:20 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.info" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-547748389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c598bf-7d36-4b68-89ef-a8fba440a4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fb74341c47406485305df042e90f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:17Z,use_quota=True,user_id='f926816d7b1b4fb0b679f73da31346b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Creating volume f4c598bf-7d36-4b68-89ef-a8fba440a4d7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:20 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:20 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 1073741824 Jul 21 17:21:20 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-540daac0-2904-4220-83bf-54352946e242 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Create snapshot completed successfully Jul 21 17:21:20 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa.0ebfd5f6-c73e-4950-a386-4fd2969c6804" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-0ebfd5f6-c73e-4950-a386-4fd2969c6804" released by "_delete_snapshot" :: held 1.503s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" released by "delete_snapshot" :: held 1.529s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-027f6fcd-bda1-4d45-96e7-182915a2a932" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-027f6fcd-bda1-4d45-96e7-182915a2a932" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-ac093381-b06f-4ff7-94c1-9ea7dca15b42" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-ac093381-b06f-4ff7-94c1-9ea7dca15b42" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Deleting offline snapshot ac093381-b06f-4ff7-94c1-9ea7dca15b42 of volume 027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] snapshot_file for this snap is: volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[122087d6-80dd-4398-9221-ef38234d8cf0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:20 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 Jul 21 17:21:20 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:20 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 1073741824" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:20 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 Jul 21 17:21:20 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:21 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-027f6fcd-bda1-4d45-96e7-182915a2a932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf599ef9-a304-4b16-ad01-a4af5af809da]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:21 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.450s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db5660a-db0a-4a04-8573-260bcfd24c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa51046-c94f-4e44-b483-9b55e967cd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Creating offline snapshot 4dd57fed-370d-47b4-bb08-f8a3c62ec573 of volume 071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:21 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 Jul 21 17:21:21 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:21 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Volume volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 (f4c598bf-7d36-4b68-89ef-a8fba440a4d7): created successfully Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa51046-c94f-4e44-b483-9b55e967cd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Flow 'volume_create_manager' (c65bad89-1dbe-4c6c-ac6b-3fb98e5fbdc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427779c-a174-4213-a9f3-b7082cffedd3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f0cb461a-d08f-4afb-9fde-eae46931e630 tempest-VolumesServicesTestJSON-742271606 None] Created volume successfully. Jul 21 17:21:21 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 Jul 21 17:21:21 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:21 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932" returned: 0 in 0.395s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:21 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 Jul 21 17:21:21 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "cinder-a8e68827-7027-46c1-b952-e126c1f510b6-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-a8e68827-7027-46c1-b952-e126c1f510b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "cinder-quobyte-59f1b213-5607-4c9d-8deb-e1942ef6ce92" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-quobyte-59f1b213-5607-4c9d-8deb-e1942ef6ce92" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "cinder-quobyte-a8e68827-7027-46c1-b952-e126c1f510b6" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:21 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-quobyte-a8e68827-7027-46c1-b952-e126c1f510b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Deleting offline snapshot a8e68827-7027-46c1-b952-e126c1f510b6 of volume 59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] snapshot_file for this snap is: volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974" returned: 0 in 0.439s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c12a20-e897-4b89-93e2-f96043e5a0c5]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:21 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 1G Jul 21 17:21:21 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:21 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 Jul 21 17:21:21 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:21 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42" returned: 0 in 0.405s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:21 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42 Jul 21 17:21:21 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Acquiring lock "cinder-f4c598bf-7d36-4b68-89ef-a8fba440a4d7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Lock "cinder-f4c598bf-7d36-4b68-89ef-a8fba440a4d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:22 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6" returned: 0 in 0.466s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:21:22 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 1G" returned: 0 in 0.506s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-071f84bc-65c4-472c-b91f-2cef91115974 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[08075882-17e7-4bb0-b1b1-a17d5a88c481]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-071f84bc-65c4-472c-b91f-2cef91115974 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Acquiring lock "cinder-quobyte-f4c598bf-7d36-4b68-89ef-a8fba440a4d7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:22 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932.ac093381-b06f-4ff7-94c1-9ea7dca15b42" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Lock "cinder-quobyte-f4c598bf-7d36-4b68-89ef-a8fba440a4d7" acquired by "delete_volume" :: waited 0.049s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-ac093381-b06f-4ff7-94c1-9ea7dca15b42" released by "_delete_snapshot" :: held 1.597s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-027f6fcd-bda1-4d45-96e7-182915a2a932" released by "delete_snapshot" :: held 1.622s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a3edc-8130-4fc3-a3f0-f84fb8e172ad]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 Jul 21 17:21:22 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack cinder-volume[87591]: WARNING cinder.quota [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2003513818 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2003513818, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:22 devstack cinder-volume[87591]: WARNING cinder.quota [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2003513818 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2003513818, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Created reservations ['c966e8ee-a7d1-432c-99d4-648409629c5a', 'f3cc1080-c145-4409-9b95-1f9dfb926eed', '76f09ed7-b1cc-460c-9b45-a2785499509f', '6624f2d5-9fd4-4a30-afd1-b0647cb59faf'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:22 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 Jul 21 17:21:22 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-071f84bc-65c4-472c-b91f-2cef91115974 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573" returned: 0 in 0.356s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 is being set with open permissions: ugo+rw Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 Jul 21 17:21:22 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] Created reservations ['c628a44f-5db9-4fb6-a58d-bf24233a4c41', '6d41a5e4-70fe-438b-9076-87cd4c3ee1c8', '5e248c93-0a2c-4df3-a79b-fef3a6c17860', 'd40bf328-88ba-40df-92f3-a73460aa7904'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:22 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92" returned: 0 in 0.443s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 Jul 21 17:21:22 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1fed8fd9-a9bc-4ff6-9220-d80b6f058d7d tempest-GroupSnapshotsTest-445642441 None] group_snapshot 45b036ce-280e-49f3-846d-22b81aa7b09c: deleted successfully Jul 21 17:21:22 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7" returned: 0 in 0.464s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7 Jul 21 17:21:22 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:22 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:22 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info Jul 21 17:21:22 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:23 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6" returned: 0 in 0.370s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:23 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f4c598bf-7d36-4b68-89ef-a8fba440a4d7" returned: 0 in 0.276s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:23 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6 Jul 21 17:21:23 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Lock "cinder-quobyte-f4c598bf-7d36-4b68-89ef-a8fba440a4d7" released by "delete_volume" :: held 0.793s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Created reservations ['85443e53-8d18-4d78-924e-0225d2e192f8', '74e26f05-ec97-4075-8940-cb298ed2c931', 'e743d4b4-8e17-4782-a004-5931189bcf02', '8f42bacb-7779-45fe-b482-d462ac0ce36f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:23 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:23 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info is being set with open permissions: ugo+rw Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:23 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info Jul 21 17:21:23 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:23 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:23 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:23 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92.a8e68827-7027-46c1-b952-e126c1f510b6" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-quobyte-a8e68827-7027-46c1-b952-e126c1f510b6" released by "_delete_snapshot" :: held 1.694s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-quobyte-59f1b213-5607-4c9d-8deb-e1942ef6ce92" released by "delete_snapshot" :: held 1.719s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:23 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.info" returned: 0 in 0.290s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Created reservations ['2c3fb02e-ee90-4891-8289-eba08ea28c5f', '4a037a5f-b768-48b1-a85a-4daa02ba4521', '2c98a183-f6da-46dd-af3f-4a36bcd079d8', 'bae2b417-9aa0-4ebf-b8b5-319f81ce9e36'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b680ee33-c4f7-44c7-9e90-12a3170e0044 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Create snapshot completed successfully Jul 21 17:21:23 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Deleted volume successfully. Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2c6ea8c2-95ba-4bc5-a7fb-f51efd08d464 tempest-VolumesServicesTestJSON-742271606 None] Lock "cinder-f4c598bf-7d36-4b68-89ef-a8fba440a4d7-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Delete snapshot completed successfully. Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45981d1f-da03-48b0-b4f3-361f8a3a4751 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-a8e68827-7027-46c1-b952-e126c1f510b6-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "cinder-59f1b213-5607-4c9d-8deb-e1942ef6ce92-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-59f1b213-5607-4c9d-8deb-e1942ef6ce92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "cinder-quobyte-59f1b213-5607-4c9d-8deb-e1942ef6ce92" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-quobyte-59f1b213-5607-4c9d-8deb-e1942ef6ce92" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe3bfd-4da4-4ced-b0ff-74e5d854aae2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-027f6fcd-bda1-4d45-96e7-182915a2a932" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-027f6fcd-bda1-4d45-96e7-182915a2a932" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2401bc51-46ab-406e-bda8-b22133c403a2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:24 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 Jul 21 17:21:24 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:24 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 Jul 21 17:21:24 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:24 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92" returned: 0 in 0.462s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "cinder-4dd57fed-370d-47b4-bb08-f8a3c62ec573-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:24 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92 Jul 21 17:21:24 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-4dd57fed-370d-47b4-bb08-f8a3c62ec573-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "cinder-quobyte-071f84bc-65c4-472c-b91f-2cef91115974" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-quobyte-071f84bc-65c4-472c-b91f-2cef91115974" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "cinder-quobyte-4dd57fed-370d-47b4-bb08-f8a3c62ec573" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-quobyte-4dd57fed-370d-47b4-bb08-f8a3c62ec573" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Deleting offline snapshot 4dd57fed-370d-47b4-bb08-f8a3c62ec573 of volume 071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] snapshot_file for this snap is: volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:21:24 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[96baeea5-f8d5-41a8-93cb-58a93d41e5a0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932" returned: 0 in 0.495s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:24 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932 Jul 21 17:21:24 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:24 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 Jul 21 17:21:24 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:24 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-59f1b213-5607-4c9d-8deb-e1942ef6ce92" returned: 0 in 0.321s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-quobyte-59f1b213-5607-4c9d-8deb-e1942ef6ce92" released by "delete_volume" :: held 0.886s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Created reservations ['777f6496-8407-4181-954a-cca2ab390ce5', 'ae176274-3ab8-431a-a959-c2ab830f44f4', '41177d53-2d44-4ee0-81aa-3abab9cf68db', '2dcfeb4f-5e10-4084-901d-f34ff3c92095'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:24 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-027f6fcd-bda1-4d45-96e7-182915a2a932" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-027f6fcd-bda1-4d45-96e7-182915a2a932" released by "delete_volume" :: held 0.867s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a445f-695f-45e0-b130-caa43971eff2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:25 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-071f84bc-65c4-472c-b91f-2cef91115974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[79899d32-e3b5-478c-9943-844058460769]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:25 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa Jul 21 17:21:25 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:25 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:25 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:25 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 Jul 21 17:21:25 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:25 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.384s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Deleted volume successfully. Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5078d740-1d63-4c33-b018-84a521729c41 tempest-VolumesSnapshotNegativeTestJSON-277092383 None] Lock "cinder-59f1b213-5607-4c9d-8deb-e1942ef6ce92-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:25 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" returned: 0 in 0.591s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:25 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa Jul 21 17:21:25 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:25 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974" returned: 0 in 0.562s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:25 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 Jul 21 17:21:25 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:25 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" returned: 0 in 0.285s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-536f5dc7-7d84-4c7c-a27c-c5c22bfc01aa" released by "delete_volume" :: held 0.958s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['28b9eb38-30e0-467a-8150-2f6eda3fcbb9'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:26 devstack cinder-volume[87591]: WARNING cinder.quota [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2003513818 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2003513818, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['76a5ab70-90d6-4541-acd2-5e4fa78e078d', '287a3e1b-3ebf-4456-9bbc-d5b27571bf67', 'd829c7b8-a5a9-4a72-8624-1ec90f60240e', '62851ce1-6ca3-46cf-bfdf-a97e5562c6a2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:26 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573" returned: 0 in 0.461s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:26 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573 Jul 21 17:21:26 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['7ca4e50d-70aa-461a-b419-6eff64022a9b', '0ee2c614-e3a7-47d6-8725-7f8fa896ca05', 'b41d3416-8b00-482c-9f58-ad571afc410e', 'b758950d-2318-4132-a81c-028d6c95fc59'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:26 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:26 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:26 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974.4dd57fed-370d-47b4-bb08-f8a3c62ec573" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-quobyte-4dd57fed-370d-47b4-bb08-f8a3c62ec573" released by "_delete_snapshot" :: held 1.937s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-quobyte-071f84bc-65c4-472c-b91f-2cef91115974" released by "delete_snapshot" :: held 1.968s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Created reservations ['dcd053e9-5b6f-40eb-8c97-439e6eacb665', '68c77f09-cd33-4819-80ca-6bc2d4a8eed5', 'cdf9b1b6-08fe-40e0-a5fb-2f644dcd8ed2', '59f37146-1a07-4726-88db-3c9db1cf92ef'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Delete snapshot completed successfully. Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a94715b7-8f22-42b5-8fa0-da84fc372bf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-4dd57fed-370d-47b4-bb08-f8a3c62ec573-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:26 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.311s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-744a3234-044c-4c74-b4b0-4bc4a7b0be12 tempest-GroupSnapshotsTest-445642441 None] Delete group completed successfully. Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "cinder-071f84bc-65c4-472c-b91f-2cef91115974-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-071f84bc-65c4-472c-b91f-2cef91115974-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "cinder-quobyte-071f84bc-65c4-472c-b91f-2cef91115974" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-quobyte-071f84bc-65c4-472c-b91f-2cef91115974" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b4dcd2-96e9-4268-b0b6-f1ff4bfb583d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:27 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 Jul 21 17:21:27 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-be981964-fd5a-4d38-b52d-e99de54e4faf tempest-GroupSnapshotsTest-445642441 None] Group tempest-GroupSnapshotsTest-Group-1873714501: creating Jul 21 17:21:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-be981964-fd5a-4d38-b52d-e99de54e4faf tempest-GroupSnapshotsTest-445642441 None] Group tempest-GroupSnapshotsTest-Group-1873714501: created successfully Jul 21 17:21:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-be981964-fd5a-4d38-b52d-e99de54e4faf tempest-GroupSnapshotsTest-445642441 None] Create group completed successfully. Jul 21 17:21:27 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974" returned: 0 in 0.468s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:27 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974 Jul 21 17:21:27 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:27 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-071f84bc-65c4-472c-b91f-2cef91115974" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-quobyte-071f84bc-65c4-472c-b91f-2cef91115974" released by "delete_volume" :: held 0.815s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=222,cinder:SELECT=205,cinder:INSERT=49,cinder:DELETE=11 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:21:27 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Created reservations ['7f397895-84b7-43d7-ab3e-aa1ab2c76f35', '6ca1fd5d-0ad5-4eed-8cb3-ba4117fff2b5', '6fefe6c6-dc1f-4b5a-b16d-2d5e67a82437', 'eb2290cd-0da1-483f-ad34-de39cc60d84a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:28 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:28 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:28 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.293s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Deleted volume successfully. Jul 21 17:21:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9adb262-5ea4-4d8a-8ac6-28c8462f771d tempest-VolumeSnapshotQuotasNegativeTestJSON-1452668674 None] Lock "cinder-071f84bc-65c4-472c-b91f-2cef91115974-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (9a874fa8-df79-4e45-8e5f-b02b8e126d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6de7da4-91cc-427d-af32-2c447843f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6de7da4-91cc-427d-af32-2c447843f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574750626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a01cd1b6-6abf-4775-aeec-c81baa252c80,host='devstack@QuobyteHD#QuobyteHD',id=8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:29Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ba55b4-59d5-4299-a027-82cffad0417e),volume_type_id=d4ba55b4-59d5-4299-a027-82cffad0417e)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28ee2f6-a0ad-4d1a-9f21-3949e0491907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28ee2f6-a0ad-4d1a-9f21-3949e0491907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d151998b-70c1-4993-8eca-e47df5761179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d151998b-70c1-4993-8eca-e47df5761179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7', 'volume_name': 'volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d1504-1166-4d50-9e4a-8cfb56d54ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d1504-1166-4d50-9e4a-8cfb56d54ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6232ecf0-eab7-4166-b397-5ca5bf1ae157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Volume 8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7', 'volume_size': 1} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a01cd1b6-6abf-4775-aeec-c81baa252c80,created_at=2026-07-21T15:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574750626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a01cd1b6-6abf-4775-aeec-c81baa252c80,host='devstack@QuobyteHD#QuobyteHD',id=8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4231622919b944efa707b448cdb10f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:29Z,use_quota=True,user_id='6fefd531c6c7478aa0253865586e27a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ba55b4-59d5-4299-a027-82cffad0417e),volume_type_id=d4ba55b4-59d5-4299-a027-82cffad0417e)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Creating volume 8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:29 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:29 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 1073741824 Jul 21 17:21:29 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Flow 'volume_create_manager' (23219255-609b-4718-883d-567b968bac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf5ed88-c706-44ba-9b23-022984e701af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf5ed88-c706-44ba-9b23-022984e701af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1642397965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8ee5b619e94453881a03d290c0ed7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:29Z,use_quota=True,user_id='596d094057af40c6b8c6ce9966705730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b1f6eb-dcf3-4641-bbef-9dd4f8a8d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b1f6eb-dcf3-4641-bbef-9dd4f8a8d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18377af5-cbd8-4687-b98f-7b16762d84bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18377af5-cbd8-4687-b98f-7b16762d84bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6', 'volume_name': 'volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfb562b-b0d0-4874-8c93-36247ebe445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfb562b-b0d0-4874-8c93-36247ebe445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65752552-ff11-4230-be20-e3afd7c2e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:29 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Volume 228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6', 'volume_size': 1} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:29 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 1073741824" returned: 0 in 0.563s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:29 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 Jul 21 17:21:29 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:30 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1642397965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8ee5b619e94453881a03d290c0ed7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:29Z,use_quota=True,user_id='596d094057af40c6b8c6ce9966705730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Creating volume 228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:30 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6232ecf0-eab7-4166-b397-5ca5bf1ae157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:30 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 1073741824 Jul 21 17:21:30 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3c574f-0732-4f95-b4a7-5da57754324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Volume volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 (8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7): created successfully Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3c574f-0732-4f95-b4a7-5da57754324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Flow 'volume_create_manager' (9a874fa8-df79-4e45-8e5f-b02b8e126d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4fc40664-8146-4e5b-ad10-59156d68a09d tempest-GroupSnapshotsTest-445642441 None] Created volume successfully. Jul 21 17:21:30 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 1073741824" returned: 0 in 0.605s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:30 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 Jul 21 17:21:30 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:31 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65752552-ff11-4230-be20-e3afd7c2e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5582ed62-c0c4-403c-8c61-d21a68bbb4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:31 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Volume volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 (228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6): created successfully Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5582ed62-c0c4-403c-8c61-d21a68bbb4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Flow 'volume_create_manager' (23219255-609b-4718-883d-567b968bac68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4530d501-1efe-4255-9f58-6d0d8c469169 tempest-SnapshotMetadataTestJSON-2117310437 None] Created volume successfully. Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] GroupSnapshot 2fc51e92-d4a2-4c2a-9162-9f5bd9e4a653: creating. Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Creating offline snapshot 4a089bb2-c871-4aa4-bfba-b49d633c7057 of volume 228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Group snapshot 2fc51e92-d4a2-4c2a-9162-9f5bd9e4a653: creating. {{(pid=87591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b7cbe-1a14-4d42-b519-0dfad7e8f11b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:32 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 Jul 21 17:21:32 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:32 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" returned: 0 in 0.407s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:32 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 1G Jul 21 17:21:32 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:32 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 1G" returned: 0 in 0.477s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:32 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 Jul 21 17:21:32 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:33 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:33 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 is being set with open permissions: ugo+rw Jul 21 17:21:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:33 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 Jul 21 17:21:33 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:33 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057" returned: 0 in 0.285s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:33 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info Jul 21 17:21:33 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:33 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:33 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info is being set with open permissions: ugo+rw Jul 21 17:21:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:33 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info Jul 21 17:21:33 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:34 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.info" returned: 0 in 0.340s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.223s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Creating offline snapshot 1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de of volume 8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f36015f-6e65-4ef1-9ad5-0055f759c9cd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:34 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-bacfa57c-964b-440c-bd9f-71feb42a6dde tempest-SnapshotMetadataTestJSON-2117310437 None] Create snapshot completed successfully Jul 21 17:21:34 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 Jul 21 17:21:34 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:34 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" returned: 0 in 0.518s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:34 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de 1G Jul 21 17:21:34 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:35 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de 1G" returned: 0 in 0.687s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:35 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de Jul 21 17:21:35 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:35 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" returned: 0 in 0.474s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:35 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:21:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:36 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de Jul 21 17:21:36 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "cinder-4a089bb2-c871-4aa4-bfba-b49d633c7057-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-4a089bb2-c871-4aa4-bfba-b49d633c7057-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "cinder-quobyte-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-quobyte-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "cinder-quobyte-4a089bb2-c871-4aa4-bfba-b49d633c7057" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-quobyte-4a089bb2-c871-4aa4-bfba-b49d633c7057" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Deleting offline snapshot 4a089bb2-c871-4aa4-bfba-b49d633c7057 of volume 228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:21:36 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] snapshot_file for this snap is: volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" returned: 0 in 0.491s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70b3990-6c28-424f-a7ef-cc66a95444ce]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:36 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info Jul 21 17:21:36 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:36 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 Jul 21 17:21:36 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:36 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057" returned: 0 in 0.503s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[32db1786-0071-4263-8a0b-7f2e2d64a7bb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:37 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info" returned: 0 in 0.532s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:37 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:37 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info Jul 21 17:21:37 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:37 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 Jul 21 17:21:37 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:37 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.info" returned: 0 in 0.364s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.243s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:37 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" returned: 0 in 0.497s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ef71e8cc-f7c7-4d8e-ab86-fb4f6add1185 tempest-GroupSnapshotsTest-445642441 None] group_snapshot 2fc51e92-d4a2-4c2a-9162-9f5bd9e4a653: created successfully Jul 21 17:21:37 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 Jul 21 17:21:37 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:37 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057" returned: 0 in 0.403s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:37 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057 Jul 21 17:21:37 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:38 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6.4a089bb2-c871-4aa4-bfba-b49d633c7057" returned: 0 in 0.291s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-quobyte-4a089bb2-c871-4aa4-bfba-b49d633c7057" released by "_delete_snapshot" :: held 1.876s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-quobyte-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" released by "delete_snapshot" :: held 1.920s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Created reservations ['0300584c-6293-49b7-b9d8-dc07bdb1405a', 'da7926c3-d100-4ab1-98d3-0a888e6614eb', 'e1e4570d-45eb-4a87-8c86-168cd4a6ef16', '745e3243-97f1-4711-b2d3-3a5e5eb96f0a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Delete snapshot completed successfully. Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e4ff8b4b-7080-4e60-a822-26219c55808d tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-4a089bb2-c871-4aa4-bfba-b49d633c7057-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] group_snapshot 2fc51e92-d4a2-4c2a-9162-9f5bd9e4a653: deleting Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] group_snapshot 2fc51e92-d4a2-4c2a-9162-9f5bd9e4a653: deleting {{(pid=87591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Deleting offline snapshot 1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de of volume 8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] snapshot_file for this snap is: volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "cinder-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[41584ce9-b661-41af-9b77-69b0935ead77]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "cinder-quobyte-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-quobyte-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:38 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de Jul 21 17:21:38 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d87e04a-8b31-4323-8395-4eacf8f55ff8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:39 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 Jul 21 17:21:39 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:39 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" returned: 0 in 0.499s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ec2a93-5767-43ad-b802-54498dd0a8bd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:39 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" returned: 0 in 0.423s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:39 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 Jul 21 17:21:39 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:39 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6 Jul 21 17:21:39 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:39 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" returned: 0 in 0.317s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-quobyte-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6" released by "delete_volume" :: held 0.842s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:39 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" returned: 0 in 0.504s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:39 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de Jul 21 17:21:39 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:39 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Created reservations ['e6b61d41-c954-47a2-b7f6-1bd389b00b8d', 'b08691c0-840a-4f36-83cb-a7bc6b204293', '4b778972-3829-49bb-aa6c-3b6e10473ea7', '0cef8fb8-a56f-41fe-ae94-64aed935cc3f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:40 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:40 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:40 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" returned: 0 in 0.517s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:40 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:40 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de Jul 21 17:21:40 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Deleted volume successfully. Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2f3bdf12-8957-4742-9c8a-e95c252decf1 tempest-SnapshotMetadataTestJSON-2117310437 None] Lock "cinder-228f3ecc-cb09-4b2f-8b76-0ddb82bce9e6-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:40 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7.1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" returned: 0 in 0.317s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-1ac1b84e-eea5-4e34-9ce9-d04c4f79e8de" released by "_delete_snapshot" :: held 1.985s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" released by "delete_snapshot" :: held 2.023s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:40 devstack cinder-volume[87591]: WARNING cinder.quota [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2147028169 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2147028169, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:40 devstack cinder-volume[87591]: WARNING cinder.quota [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2147028169 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2147028169, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:40 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] Created reservations ['495b87df-e955-40d1-98ff-202f30113d55', '5fd6ee0e-ec69-4e28-ab8b-a2e4c696cef5', '317a2356-f09b-4297-a9f4-c33d9b4ad29c', '63c94575-1985-4f81-9022-da38e84a8266'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0fc917df-1ce7-4e81-a29b-fba73bfeab4c tempest-GroupSnapshotsTest-445642441 None] group_snapshot 2fc51e92-d4a2-4c2a-9162-9f5bd9e4a653: deleted successfully Jul 21 17:21:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "cinder-quobyte-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7808cac-e9cc-4d13-a442-441c7582defd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:41 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 Jul 21 17:21:41 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:42 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:42 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:42 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" returned: 0 in 0.637s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:42 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7 Jul 21 17:21:42 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:42 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 8 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:21:42 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" returned: 0 in 0.394s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Lock "cinder-quobyte-8ce3ace4-bed9-4a7c-bec8-a7856af9d4d7" released by "delete_volume" :: held 1.164s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['92d353a3-4824-485d-b6e7-8c8ae2252f53'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:42 devstack cinder-volume[87591]: WARNING cinder.quota [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2147028169 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2147028169, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:21:42 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Created reservations ['c6e59232-aaf2-4788-9f04-c17b9092d6f9', '090455c3-78de-4c9c-813f-3008c76039f7', '7f93a1b9-dcd9-4799-a8f0-28114d9e5aa6', '6c6f5c90-540d-42a4-835c-57eb914541e8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:43 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:43 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:43 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.333s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:43 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5f43f159-585a-4685-b2b0-520efbe84bb4 tempest-GroupSnapshotsTest-445642441 None] Delete group completed successfully. Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Flow 'volume_create_manager' (e8e35f71-0c76-48f8-a88c-c207958d54d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5b9c5f-0575-426d-8d0e-c8edb545ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5b9c5f-0575-426d-8d0e-c8edb545ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1236648649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c5bc3b-a422-4e54-91d8-116cf1a0468f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538937d0425746289764fde51e938c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:53Z,use_quota=True,user_id='fa5a4f4a927b41bc9caf1300928546c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcbe15b-5a86-49b5-a594-3e99fb4970e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcbe15b-5a86-49b5-a594-3e99fb4970e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078a21b0-b06f-456a-be53-286d1dc2d913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078a21b0-b06f-456a-be53-286d1dc2d913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c5bc3b-a422-4e54-91d8-116cf1a0468f', 'volume_name': 'volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6fa74e-bf5e-4252-aa9c-21d1e839cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6fa74e-bf5e-4252-aa9c-21d1e839cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71481537-9287-4799-83ad-6fa65f4aa2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:52 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Volume 47c5bc3b-a422-4e54-91d8-116cf1a0468f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f', 'volume_size': 1} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1236648649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c5bc3b-a422-4e54-91d8-116cf1a0468f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538937d0425746289764fde51e938c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:53Z,use_quota=True,user_id='fa5a4f4a927b41bc9caf1300928546c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Creating volume 47c5bc3b-a422-4e54-91d8-116cf1a0468f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:52 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:52 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f 1073741824 Jul 21 17:21:52 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Flow 'volume_create_manager' (93f02492-2a0d-4e24-b3d6-f7e7c7308bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b3726b-04a6-4184-a204-109ef871158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b3726b-04a6-4184-a204-109ef871158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-307341112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f5fd4c-c4e2-4243-8073-f4706e6767b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17257f00a74741d093552f0be42f4d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:53Z,use_quota=True,user_id='aed15591504b4b6c95703591a2e8d550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e952dc9-4275-46b9-84b2-e697bdcf6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e952dc9-4275-46b9-84b2-e697bdcf6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2a5406-a843-44a1-a2b9-434a4f2a42e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:21:53 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f 1073741824" returned: 0 in 0.734s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:53 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f Jul 21 17:21:53 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f3d0b161-a7ce-499c-9eb4-1a0285b6c38d tempest-GroupSnapshotsV319Test-1368089008 None] Group tempest-GroupSnapshotsV319Test-Group-1959531921: creating Jul 21 17:21:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f3d0b161-a7ce-499c-9eb4-1a0285b6c38d tempest-GroupSnapshotsV319Test-1368089008 None] Group tempest-GroupSnapshotsV319Test-Group-1959531921: created successfully Jul 21 17:21:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f3d0b161-a7ce-499c-9eb4-1a0285b6c38d tempest-GroupSnapshotsV319Test-1368089008 None] Create group completed successfully. Jul 21 17:21:53 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f" returned: 0 in 0.276s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71481537-9287-4799-83ad-6fa65f4aa2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab8b613-16df-4dc0-bba3-e0929e714572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Volume volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f (47c5bc3b-a422-4e54-91d8-116cf1a0468f): created successfully Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab8b613-16df-4dc0-bba3-e0929e714572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Flow 'volume_create_manager' (e8e35f71-0c76-48f8-a88c-c207958d54d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4b3df661-8e22-4511-91b0-ef97c98c444c tempest-VolumesTransfersV357Test-2110170243 None] Created volume successfully. Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2a5406-a843-44a1-a2b9-434a4f2a42e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96f5fd4c-c4e2-4243-8073-f4706e6767b8', 'volume_name': 'volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfcb087-b23f-450f-bbcf-71de8e3b34c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfcb087-b23f-450f-bbcf-71de8e3b34c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af852002-ef5c-4df1-9487-5db23d7a4750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Volume 96f5fd4c-c4e2-4243-8073-f4706e6767b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 17:21:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Trying to clone 96f5fd4c-c4e2-4243-8073-f4706e6767b8 from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:21:54 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Image download 20.69 MB at 20.69 MB/s Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4daa50-d08d-4009-90d4-2c1270575dd0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:54 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD Jul 21 17:21:54 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:54 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 is fetched for user aed15591504b4b6c95703591a2e8d550. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1fcb5f-fda8-4d04-895b-394ccc168e25]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:54 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD Jul 21 17:21:54 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:55 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-307341112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f5fd4c-c4e2-4243-8073-f4706e6767b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17257f00a74741d093552f0be42f4d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:53Z,use_quota=True,user_id='aed15591504b4b6c95703591a2e8d550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Creating volume 96f5fd4c-c4e2-4243-8073-f4706e6767b8 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:55 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:55 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 1073741824 Jul 21 17:21:55 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-44004671-40ff-4009-9390-cb42c427b413 tempest-VolumesTransfersV357Test-1366727168 None] Transfer volume completed successfully. Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Flow 'volume_create_manager' (be316b39-770c-45ad-93ab-58d192eb247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfdc30c-ee9c-4edc-9d72-55cd8516c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfdc30c-ee9c-4edc-9d72-55cd8516c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1151798261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94460c1b-866e-4a58-bbca-b045393093e3,host='devstack@QuobyteHD#QuobyteHD',id=d58ae0e3-e5db-4b10-a965-20529cbb84aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3639827db074d7892ba8ce9ccfd065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:55Z,use_quota=True,user_id='4a1e2c50caae4e659e94aa496d17360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5756776-74fb-4626-b301-a9fc5eebf546),volume_type_id=e5756776-74fb-4626-b301-a9fc5eebf546)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e55111-e547-4633-9e0b-a0bebde2578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e55111-e547-4633-9e0b-a0bebde2578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd3b23e-67dc-44d2-b669-bbcb13a30c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd3b23e-67dc-44d2-b669-bbcb13a30c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58ae0e3-e5db-4b10-a965-20529cbb84aa', 'volume_name': 'volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dcd41f-6579-476d-afee-cd356f08464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dcd41f-6579-476d-afee-cd356f08464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19c9870-67ad-437a-943d-1a2c365699d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Volume d58ae0e3-e5db-4b10-a965-20529cbb84aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa', 'volume_size': 1} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:55 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 1073741824" returned: 0 in 0.585s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:55 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 Jul 21 17:21:55 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Acquiring lock "cinder-47c5bc3b-a422-4e54-91d8-116cf1a0468f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-47c5bc3b-a422-4e54-91d8-116cf1a0468f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Acquiring lock "cinder-quobyte-47c5bc3b-a422-4e54-91d8-116cf1a0468f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-quobyte-47c5bc3b-a422-4e54-91d8-116cf1a0468f" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f9b27-34b7-4dfe-a8ad-9e518ef27c9a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:56 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94460c1b-866e-4a58-bbca-b045393093e3,created_at=2026-07-21T15:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1151798261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94460c1b-866e-4a58-bbca-b045393093e3,host='devstack@QuobyteHD#QuobyteHD',id=d58ae0e3-e5db-4b10-a965-20529cbb84aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3639827db074d7892ba8ce9ccfd065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:55Z,use_quota=True,user_id='4a1e2c50caae4e659e94aa496d17360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5756776-74fb-4626-b301-a9fc5eebf546),volume_type_id=e5756776-74fb-4626-b301-a9fc5eebf546)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Creating volume d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:56 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:56 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f Jul 21 17:21:56 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:56 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa 1073741824 Jul 21 17:21:56 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Attempting download of 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 96f5fd4c-c4e2-4243-8073-f4706e6767b8. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d6f56-8ad3-482d-8c4a-192adde594b7]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:56 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1 Jul 21 17:21:56 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:56 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:56 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f Jul 21 17:21:56 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:56 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1" returned: 0 in 0.410s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:56 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa 1073741824" returned: 0 in 0.546s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:56 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1 Jul 21 17:21:56 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:56 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-47c5bc3b-a422-4e54-91d8-116cf1a0468f" returned: 0 in 0.293s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:56 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa Jul 21 17:21:56 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-quobyte-47c5bc3b-a422-4e54-91d8-116cf1a0468f" released by "delete_volume" :: held 0.825s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:56 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Created reservations ['d5ac2422-4b95-4c92-ab6c-2f16bb5795a6', 'ae856bfb-19b4-4b18-bcae-bf9baa1bc4e0', '073f5c39-beda-4b7e-b82b-e450fc0ae8ec', '88fcce7b-b8cc-4a59-8131-c5d3fb6af9af'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:57 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:21:57 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:57 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1" returned: 1 in 0.396s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_8ahmeqd1' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[500bd0b7-bf88-4d7a-84b9-0c852a87dc38]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:57 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19c9870-67ad-437a-943d-1a2c365699d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f1de31-64c2-49f0-9324-72fcb477d121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Volume volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa (d58ae0e3-e5db-4b10-a965-20529cbb84aa): created successfully Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f1de31-64c2-49f0-9324-72fcb477d121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Flow 'volume_create_manager' (be316b39-770c-45ad-93ab-58d192eb247f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6af4845e-6764-43ad-9b80-6f01735a1e13 tempest-GroupSnapshotsV319Test-1368089008 None] Created volume successfully. Jul 21 17:21:57 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD Jul 21 17:21:57 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:57 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.329s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:21:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Deleted volume successfully. Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f900d7a-b12f-4c52-a0ac-39397ba46f12 tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-47c5bc3b-a422-4e54-91d8-116cf1a0468f-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:21:57 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] 2aa331ac-4aaf-451f-bbe4-0351cabe0710 was qcow2, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:57 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 Jul 21 17:21:57 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Flow 'volume_create_manager' (db0c48a2-fcc2-4910-a958-6548dedc374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf17736-9657-4755-87cb-bff8ff308993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf17736-9657-4755-87cb-bff8ff308993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-632382176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93be264d-e130-4808-912a-35a867ea9975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538937d0425746289764fde51e938c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:58Z,use_quota=True,user_id='fa5a4f4a927b41bc9caf1300928546c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba656875-6ebd-4105-b273-09a8042a5f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba656875-6ebd-4105-b273-09a8042a5f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d7418f-e50f-4d6e-814c-45e3df673a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d7418f-e50f-4d6e-814c-45e3df673a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93be264d-e130-4808-912a-35a867ea9975', 'volume_name': 'volume-93be264d-e130-4808-912a-35a867ea9975', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743edccf-66d1-46e8-b51d-46dbe22a527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743edccf-66d1-46e8-b51d-46dbe22a527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118ed149-fbf6-456e-a2d5-63bdf841c518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Volume 93be264d-e130-4808-912a-35a867ea9975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93be264d-e130-4808-912a-35a867ea9975', 'volume_size': 1} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-632382176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93be264d-e130-4808-912a-35a867ea9975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538937d0425746289764fde51e938c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:58Z,use_quota=True,user_id='fa5a4f4a927b41bc9caf1300928546c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Creating volume 93be264d-e130-4808-912a-35a867ea9975 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:57 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:57 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 1073741824 Jul 21 17:21:57 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Flow 'volume_create_manager' (120003f5-fedc-43c4-8b5e-3912eea5ac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818ae2c8-0a53-4cb0-bbeb-78ceb62349f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818ae2c8-0a53-4cb0-bbeb-78ceb62349f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-155239228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55739145-2df8-40fe-8c8a-9f4f457363e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe49e79cc4344dd186a8dd0fe9ab5af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:58Z,use_quota=True,user_id='010d7d6ce6f34337963a7c5e7501e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(254c4321-fd26-4ee8-ba04-4f55b4fca551),volume_type_id=254c4321-fd26-4ee8-ba04-4f55b4fca551)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a40308-7cff-407e-858f-12a4075aec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a40308-7cff-407e-858f-12a4075aec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478759b6-7e4b-4837-8969-3c8a2b0ac1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478759b6-7e4b-4837-8969-3c8a2b0ac1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55739145-2df8-40fe-8c8a-9f4f457363e8', 'volume_name': 'volume-55739145-2df8-40fe-8c8a-9f4f457363e8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b424d7-245e-4b6c-9c8d-156a6394cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b424d7-245e-4b6c-9c8d-156a6394cb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5e39e5-cd62-468f-a77b-7e37e98af005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume 55739145-2df8-40fe-8c8a-9f4f457363e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55739145-2df8-40fe-8c8a-9f4f457363e8', 'volume_size': 1} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] GroupSnapshot 3617d803-7af4-462e-9e32-bf3334cb1c75: creating. Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Group snapshot 3617d803-7af4-462e-9e32-bf3334cb1c75: creating. {{(pid=87591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:58 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 1073741824" returned: 0 in 0.630s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:58 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 Jul 21 17:21:58 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Flow 'volume_create_manager' (ed08843a-2fda-41da-b24a-b04045104721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d1031b-92c5-42af-9238-fd02b1d262bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d1031b-92c5-42af-9238-fd02b1d262bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1201414696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9431ed45-6dbf-462d-9104-17a19f77c80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe49e79cc4344dd186a8dd0fe9ab5af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:59Z,use_quota=True,user_id='010d7d6ce6f34337963a7c5e7501e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cb31d31-633f-47c4-8b03-b465958fd428),volume_type_id=1cb31d31-633f-47c4-8b03-b465958fd428)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8855ac-092e-4860-aeca-d9bec1470c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8855ac-092e-4860-aeca-d9bec1470c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3e7f1e-733b-4205-80af-861e14bb9649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3e7f1e-733b-4205-80af-861e14bb9649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9431ed45-6dbf-462d-9104-17a19f77c80d', 'volume_name': 'volume-9431ed45-6dbf-462d-9104-17a19f77c80d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4773fc77-1f55-4186-a1d0-5dda5eb74644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4773fc77-1f55-4186-a1d0-5dda5eb74644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe6a2ac-b558-4ea0-a9b4-f0aeafd9b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume 9431ed45-6dbf-462d-9104-17a19f77c80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9431ed45-6dbf-462d-9104-17a19f77c80d', 'volume_size': 1} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:58 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975" returned: 0 in 0.324s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-155239228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55739145-2df8-40fe-8c8a-9f4f457363e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe49e79cc4344dd186a8dd0fe9ab5af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:58Z,use_quota=True,user_id='010d7d6ce6f34337963a7c5e7501e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(254c4321-fd26-4ee8-ba04-4f55b4fca551),volume_type_id=254c4321-fd26-4ee8-ba04-4f55b4fca551)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Creating volume 55739145-2df8-40fe-8c8a-9f4f457363e8 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:21:58 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118ed149-fbf6-456e-a2d5-63bdf841c518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93be264d-e130-4808-912a-35a867ea9975', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713e9ec6-17d0-45d0-b798-d4f69e6a067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:58 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 1073741824 Jul 21 17:21:59 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Volume volume-93be264d-e130-4808-912a-35a867ea9975 (93be264d-e130-4808-912a-35a867ea9975): created successfully Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713e9ec6-17d0-45d0-b798-d4f69e6a067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Flow 'volume_create_manager' (db0c48a2-fcc2-4910-a958-6548dedc374e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-15d9e8c1-0b63-4025-9bc1-e2958ac8a307 tempest-VolumesTransfersV357Test-2110170243 None] Created volume successfully. Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Flow 'volume_create_manager' (30c4f89e-b20b-40b6-afda-c227e1c5744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8e800c-57ee-4941-9fd2-be8115e4e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8e800c-57ee-4941-9fd2-be8115e4e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1012596071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fbfaec-ab2a-4eac-9913-c27972e51b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe49e79cc4344dd186a8dd0fe9ab5af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:59Z,use_quota=True,user_id='010d7d6ce6f34337963a7c5e7501e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64c9aea1-72e8-4333-89dd-fa626936985e),volume_type_id=64c9aea1-72e8-4333-89dd-fa626936985e)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8ce575-3279-48db-b07a-c25fa9c35662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8ce575-3279-48db-b07a-c25fa9c35662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363d21b2-aa55-4ba9-ae0e-e1a885da254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:21:59 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 1073741824" returned: 0 in 0.510s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:59 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 Jul 21 17:21:59 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363d21b2-aa55-4ba9-ae0e-e1a885da254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6fbfaec-ab2a-4eac-9913-c27972e51b5a', 'volume_name': 'volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a', 'volume_size': 1, 'image_id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1865928049', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe49e79cc4344dd186a8dd0fe9ab5af6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'created_at': datetime.datetime(2026, 7, 21, 15, 21, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 21, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9/file', 'properties': {}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bf0c3c-0139-439f-ad54-d90242de2e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bf0c3c-0139-439f-ad54-d90242de2e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd4d98-77f8-48a9-a22f-ec39dffbb2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume a6fbfaec-ab2a-4eac-9913-c27972e51b5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a', 'volume_size': 1, 'image_id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1865928049', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe49e79cc4344dd186a8dd0fe9ab5af6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'created_at': datetime.datetime(2026, 7, 21, 15, 21, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 21, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9/file', 'properties': {}}, 'image_service': } Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Trying to clone a6fbfaec-ab2a-4eac-9913-c27972e51b5a from image 8a07f20a-15d4-4ae0-91de-2b64efec63f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:21:59 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8" returned: 0 in 2.178s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_9xg5rtk_devstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:21:59 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Converted 112.00 MB image at 51.40 MB/s Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:59 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 1G Jul 21 17:21:59 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:21:59 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8" returned: 0 in 0.271s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.307s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5e39e5-cd62-468f-a77b-7e37e98af005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55739145-2df8-40fe-8c8a-9f4f457363e8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2a2946-5654-4d5f-b5c8-7bafe1faa567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Creating offline snapshot fac3a038-bb05-4f59-bbd4-a201aaf6bbed of volume d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:21:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume volume-55739145-2df8-40fe-8c8a-9f4f457363e8 (55739145-2df8-40fe-8c8a-9f4f457363e8): created successfully Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2a2946-5654-4d5f-b5c8-7bafe1faa567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Flow 'volume_create_manager' (120003f5-fedc-43c4-8b5e-3912eea5ac20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8feee91-3158-4d40-abeb-d77b228f557b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:21:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:21:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a6da09d9-924e-4e12-905a-7a8f38c235e1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Created volume successfully. Jul 21 17:22:00 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa Jul 21 17:22:00 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:00 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 1G" returned: 0 in 0.425s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Downloaded image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 96f5fd4c-c4e2-4243-8073-f4706e6767b8 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 for user aed15591504b4b6c95703591a2e8d550 is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Marking volume 96f5fd4c-c4e2-4243-8073-f4706e6767b8 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Copying metadata from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 to 96f5fd4c-c4e2-4243-8073-f4706e6767b8. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Creating volume glance metadata for volume 96f5fd4c-c4e2-4243-8073-f4706e6767b8 backed by image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af852002-ef5c-4df1-9487-5db23d7a4750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35279902-5226-4877-b8ba-c40cd3e9f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:00 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Volume volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 (96f5fd4c-c4e2-4243-8073-f4706e6767b8): created successfully Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35279902-5226-4877-b8ba-c40cd3e9f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Flow 'volume_create_manager' (93f02492-2a0d-4e24-b3d6-f7e7c7308bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3485c1d1-5e87-4060-a0dd-7f5d41b8bf6f tempest-VolumesImageMetadata-1930850365 None] Created volume successfully. Jul 21 17:22:00 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa" returned: 0 in 0.470s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Acquiring lock "cinder-93be264d-e130-4808-912a-35a867ea9975-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:00 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed 1G Jul 21 17:22:00 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-93be264d-e130-4808-912a-35a867ea9975-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Acquiring lock "cinder-quobyte-93be264d-e130-4808-912a-35a867ea9975" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-quobyte-93be264d-e130-4808-912a-35a867ea9975" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[69305b98-4e84-461a-9f0f-953096b0fc4a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:00 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 Jul 21 17:22:00 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:00 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed 1G" returned: 0 in 0.424s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:00 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed Jul 21 17:22:00 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:00 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975" returned: 0 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:00 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975 Jul 21 17:22:00 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:01 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed" returned: 0 in 0.361s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:01 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:01 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed Jul 21 17:22:01 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:01 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-93be264d-e130-4808-912a-35a867ea9975" returned: 0 in 0.291s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-quobyte-93be264d-e130-4808-912a-35a867ea9975" released by "delete_volume" :: held 0.744s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Created reservations ['d87de6ae-5029-47e2-9379-b79179e37829', 'bb7752af-1be0-490b-80d5-a7cdbce6fcb6', '15921705-293f-4a6d-9636-17d131ec5f7b', '7628be6b-fdeb-4db7-8ad8-9d657a941f65'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:01 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:01 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:01 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Acquiring lock "cinder-96f5fd4c-c4e2-4243-8073-f4706e6767b8-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed" returned: 0 in 0.281s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Lock "cinder-96f5fd4c-c4e2-4243-8073-f4706e6767b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Acquiring lock "cinder-quobyte-96f5fd4c-c4e2-4243-8073-f4706e6767b8" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:01 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info Jul 21 17:22:01 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Lock "cinder-quobyte-96f5fd4c-c4e2-4243-8073-f4706e6767b8" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9810d72f-0ca1-4332-86b3-4cac0e7d9f47]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:01 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Deleted volume successfully. Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98df22f9-cac8-4a75-b072-37fd92fe19ab tempest-VolumesTransfersV357Test-1792464764 None] Lock "cinder-93be264d-e130-4808-912a-35a867ea9975-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:01 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 Jul 21 17:22:01 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:01 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info" returned: 0 in 0.366s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:01 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 17:22:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:01 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info Jul 21 17:22:01 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:02 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8" returned: 0 in 0.513s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:02 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.info" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:02 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8 Jul 21 17:22:02 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.357s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1201414696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9431ed45-6dbf-462d-9104-17a19f77c80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe49e79cc4344dd186a8dd0fe9ab5af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:59Z,use_quota=True,user_id='010d7d6ce6f34337963a7c5e7501e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cb31d31-633f-47c4-8b03-b465958fd428),volume_type_id=1cb31d31-633f-47c4-8b03-b465958fd428)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Creating volume 9431ed45-6dbf-462d-9104-17a19f77c80d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:02 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:02 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d 1073741824 Jul 21 17:22:02 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1b7f16ef-730d-42f8-92d9-40197cf2f2b9 tempest-GroupSnapshotsV319Test-1368089008 None] group_snapshot 3617d803-7af4-462e-9e32-bf3334cb1c75: created successfully Jul 21 17:22:02 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-96f5fd4c-c4e2-4243-8073-f4706e6767b8" returned: 0 in 0.335s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Lock "cinder-quobyte-96f5fd4c-c4e2-4243-8073-f4706e6767b8" released by "delete_volume" :: held 0.918s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Created reservations ['b3b29788-aefc-4467-96d3-7e52f16d4c9a', 'a7585ae4-1ef7-4371-8b9d-51ceea8dae2b', 'f1cadf0e-8221-4e05-b174-497bb5566ea6', '332330da-87e2-4486-ad7c-6cd79d49332b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:02 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:02 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:02 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d 1073741824" returned: 0 in 0.676s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:02 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d Jul 21 17:22:02 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:02 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.347s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:02 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Deleted volume successfully. Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef6fdb7c-af3c-4828-a4c3-a845916ee8f1 tempest-VolumesImageMetadata-1930850365 None] Lock "cinder-96f5fd4c-c4e2-4243-8073-f4706e6767b8-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:03 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d" returned: 0 in 0.330s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe6a2ac-b558-4ea0-a9b4-f0aeafd9b126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9431ed45-6dbf-462d-9104-17a19f77c80d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4b8ab9-ccd8-488f-9c8f-e705a9d01c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume volume-9431ed45-6dbf-462d-9104-17a19f77c80d (9431ed45-6dbf-462d-9104-17a19f77c80d): created successfully Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4b8ab9-ccd8-488f-9c8f-e705a9d01c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Flow 'volume_create_manager' (ed08843a-2fda-41da-b24a-b04045104721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-dd62f747-cd2d-479e-839a-911e9e80bfe9 tempest-TestInstancesWithCinderVolumes-1578686119 None] Created volume successfully. Jul 21 17:22:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] group_snapshot 3617d803-7af4-462e-9e32-bf3334cb1c75: deleting Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] group_snapshot 3617d803-7af4-462e-9e32-bf3334cb1c75: deleting {{(pid=87591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "cinder-quobyte-d58ae0e3-e5db-4b10-a965-20529cbb84aa" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "cinder-quobyte-d58ae0e3-e5db-4b10-a965-20529cbb84aa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "cinder-quobyte-fac3a038-bb05-4f59-bbd4-a201aaf6bbed" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "cinder-quobyte-fac3a038-bb05-4f59-bbd4-a201aaf6bbed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Deleting offline snapshot fac3a038-bb05-4f59-bbd4-a201aaf6bbed of volume d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] snapshot_file for this snap is: volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4afb3-7298-40d6-b666-b75352444b0a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:03 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed Jul 21 17:22:03 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:04 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed" returned: 0 in 0.558s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f26bf-6527-4c8d-adf7-8a8f66791d42]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:04 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa Jul 21 17:22:04 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:04 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa" returned: 0 in 0.457s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:04 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed Jul 21 17:22:04 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD, size 20.69 MB, duration 5.07 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:22:04 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Image download 20.69 MB at 4.08 MB/s Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[73608adf-cbde-43d0-8bf9-6ede61e257f9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:04 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD Jul 21 17:22:04 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:05 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed" returned: 0 in 0.478s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:05 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed Jul 21 17:22:05 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:05 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Temporary image 8a07f20a-15d4-4ae0-91de-2b64efec63f9 is fetched for user 010d7d6ce6f34337963a7c5e7501e27b. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[31053619-e9cf-4d43-834e-e0f07d7ce1d8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:05 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa.fac3a038-bb05-4f59-bbd4-a201aaf6bbed" returned: 0 in 0.318s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "cinder-quobyte-fac3a038-bb05-4f59-bbd4-a201aaf6bbed" released by "_delete_snapshot" :: held 1.953s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Lock "cinder-quobyte-d58ae0e3-e5db-4b10-a965-20529cbb84aa" released by "delete_snapshot" :: held 1.981s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:05 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD Jul 21 17:22:05 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:05 devstack cinder-volume[87591]: WARNING cinder.quota [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-851977384 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-851977384, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:22:05 devstack cinder-volume[87591]: WARNING cinder.quota [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-851977384 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-851977384, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] Created reservations ['8082b190-3b07-4545-b8c1-5661d87dbf48', 'fccf11d5-20b2-434e-8c48-24729875408a', '89ad5bd3-e300-4b43-b13e-2b0119a56a26', 'dfe03880-29d5-4a36-bc53-4e5294e0ea88'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:05 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-536274f1-8b5c-4da1-9e75-4c3cb366b9f5 tempest-GroupSnapshotsV319Test-1368089008 None] group_snapshot 3617d803-7af4-462e-9e32-bf3334cb1c75: deleted successfully Jul 21 17:22:05 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1012596071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fbfaec-ab2a-4eac-9913-c27972e51b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe49e79cc4344dd186a8dd0fe9ab5af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:21:59Z,use_quota=True,user_id='010d7d6ce6f34337963a7c5e7501e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64c9aea1-72e8-4333-89dd-fa626936985e),volume_type_id=64c9aea1-72e8-4333-89dd-fa626936985e)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Creating volume a6fbfaec-ab2a-4eac-9913-c27972e51b5a {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:05 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:05 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a 1073741824 Jul 21 17:22:05 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "cinder-quobyte-d58ae0e3-e5db-4b10-a965-20529cbb84aa" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Lock "cinder-quobyte-d58ae0e3-e5db-4b10-a965-20529cbb84aa" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d841ef9-9a8f-4268-82a9-693f0c0b94a8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:06 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa Jul 21 17:22:06 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:06 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a 1073741824" returned: 0 in 0.639s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:06 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a Jul 21 17:22:06 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:06 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa" returned: 0 in 0.464s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:06 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa Jul 21 17:22:06 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:06 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" returned: 0 in 0.363s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:06 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Attempting download of 8a07f20a-15d4-4ae0-91de-2b64efec63f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'metadata': {}}])) to volume a6fbfaec-ab2a-4eac-9913-c27972e51b5a. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97d34e-b8a5-4092-9dfb-a20355272c15]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:07 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d58ae0e3-e5db-4b10-a965-20529cbb84aa" returned: 0 in 0.330s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Lock "cinder-quobyte-d58ae0e3-e5db-4b10-a965-20529cbb84aa" released by "delete_volume" :: held 0.876s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:07 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy Jul 21 17:22:07 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Created reservations ['7858e45e-d93e-4eb3-821a-664e795585ea'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:07 devstack cinder-volume[87591]: WARNING cinder.quota [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-851977384 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-851977384, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Created reservations ['0f5c601d-6eac-4364-b23e-2db287d156fd', '4c6f5562-002b-440f-8ae6-9a33975e093c', '4b65838f-69c9-49d0-9cc7-d8af498ae490', '0bf3b6df-0f9d-4ab8-a745-75495ea04125'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:07 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:07 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:07 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:07 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy Jul 21 17:22:07 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:07 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:07 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5de2596f-a513-4386-8553-b5a7098980bc tempest-GroupSnapshotsV319Test-1368089008 None] Delete group completed successfully. Jul 21 17:22:07 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy" returned: 1 in 0.461s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a07f20a-15d4-4ae0-91de-2b64efec63f9_oedjoviy' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693a98d-a66e-404d-8235-35e5b618c5cb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:08 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD Jul 21 17:22:08 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Flow 'volume_create_manager' (1c6495de-4ea9-4726-972e-b574aee800ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee28b7b-4f39-4a5d-a76d-17153ca3cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee28b7b-4f39-4a5d-a76d-17153ca3cae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2054943072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb78e3b6-2532-4576-b591-a2cd365e1d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe6042ac0aa4b9ab28badeedd4c428d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:08Z,use_quota=True,user_id='48ae0b8ddfc24ec1bc4284a7e1d32a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9d2c9d-424c-4ae1-8b85-6e63f657c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9d2c9d-424c-4ae1-8b85-6e63f657c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f18476a-0277-42aa-88b6-cd78eed939f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f18476a-0277-42aa-88b6-cd78eed939f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb78e3b6-2532-4576-b591-a2cd365e1d7d', 'volume_name': 'volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8c9cf8-8d3f-487f-bffc-77fb787ef844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8c9cf8-8d3f-487f-bffc-77fb787ef844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb63744b-1ae3-47e7-89a6-fec6e078ad27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:08 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Volume cb78e3b6-2532-4576-b591-a2cd365e1d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d', 'volume_size': 1} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2054943072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb78e3b6-2532-4576-b591-a2cd365e1d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe6042ac0aa4b9ab28badeedd4c428d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:08Z,use_quota=True,user_id='48ae0b8ddfc24ec1bc4284a7e1d32a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Creating volume cb78e3b6-2532-4576-b591-a2cd365e1d7d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:08 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:08 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d 1073741824 Jul 21 17:22:08 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:08 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] 8a07f20a-15d4-4ae0-91de-2b64efec63f9 was qcow2, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:08 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a Jul 21 17:22:08 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:08 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d 1073741824" returned: 0 in 0.532s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:08 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d Jul 21 17:22:08 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:09 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d" returned: 0 in 0.452s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb63744b-1ae3-47e7-89a6-fec6e078ad27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f6d8da-d745-46a2-9ca9-0ee421468143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:09 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Volume volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d (cb78e3b6-2532-4576-b591-a2cd365e1d7d): created successfully Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f6d8da-d745-46a2-9ca9-0ee421468143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Flow 'volume_create_manager' (1c6495de-4ea9-4726-972e-b574aee800ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:09 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d4dc0cd2-7603-421f-ba5b-c774e89d03aa tempest-VolumesMetadataTest-481119197 None] Created volume successfully. Jul 21 17:22:10 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" returned: 0 in 2.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:10 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a07f20a-15d4-4ae0-91de-2b64efec63f9_j_hzrdeadevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:22:10 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Converted 112.00 MB image at 46.92 MB/s Jul 21 17:22:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:10 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a 1G Jul 21 17:22:10 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:11 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a 1G" returned: 0 in 0.539s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Downloaded image 8a07f20a-15d4-4ae0-91de-2b64efec63f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'metadata': {}}])) to volume a6fbfaec-ab2a-4eac-9913-c27972e51b5a successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Temporary image 8a07f20a-15d4-4ae0-91de-2b64efec63f9 for user 010d7d6ce6f34337963a7c5e7501e27b is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Marking volume a6fbfaec-ab2a-4eac-9913-c27972e51b5a as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Acquiring lock "cinder-cb78e3b6-2532-4576-b591-a2cd365e1d7d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Copying metadata from image 8a07f20a-15d4-4ae0-91de-2b64efec63f9 to a6fbfaec-ab2a-4eac-9913-c27972e51b5a. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Creating volume glance metadata for volume a6fbfaec-ab2a-4eac-9913-c27972e51b5a backed by image 8a07f20a-15d4-4ae0-91de-2b64efec63f9 with: {'image_id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'image_name': 'tempest-scenario-img--1865928049', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Lock "cinder-cb78e3b6-2532-4576-b591-a2cd365e1d7d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Acquiring lock "cinder-quobyte-cb78e3b6-2532-4576-b591-a2cd365e1d7d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Lock "cinder-quobyte-cb78e3b6-2532-4576-b591-a2cd365e1d7d" acquired by "delete_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd4d98-77f8-48a9-a22f-ec39dffbb2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a', 'volume_size': 1, 'image_id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1865928049', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe49e79cc4344dd186a8dd0fe9ab5af6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a07f20a-15d4-4ae0-91de-2b64efec63f9', 'created_at': datetime.datetime(2026, 7, 21, 15, 21, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 21, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a07f20a-15d4-4ae0-91de-2b64efec63f9/file', 'properties': {}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1421cfe9-3711-4495-9a0c-265af4620b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac380a-9bc2-4c42-aca0-e8a9d2137681]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:11 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Volume volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a (a6fbfaec-ab2a-4eac-9913-c27972e51b5a): created successfully Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1421cfe9-3711-4495-9a0c-265af4620b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Flow 'volume_create_manager' (30c4f89e-b20b-40b6-afda-c227e1c5744e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-55376fa1-be48-4d02-82c9-c4ba962a9b2e tempest-TestInstancesWithCinderVolumes-1578686119 None] Created volume successfully. Jul 21 17:22:11 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d Jul 21 17:22:11 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:11 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d" returned: 0 in 0.410s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:11 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d Jul 21 17:22:11 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:12 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cb78e3b6-2532-4576-b591-a2cd365e1d7d" returned: 0 in 0.267s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Lock "cinder-quobyte-cb78e3b6-2532-4576-b591-a2cd365e1d7d" released by "delete_volume" :: held 0.739s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Created reservations ['bdb99e31-ff98-4465-9c80-c4957c1ceeee', 'fa4d64fb-431b-424c-b1b1-b45b930e41eb', '68cff387-7611-4dc1-8d10-de94580302e5', '137593df-0da9-4735-802f-66b3d0bd053d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:12 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:12 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:12 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Deleted volume successfully. Jul 21 17:22:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-29b79bf3-d4bc-498d-bd21-7ab4d7db6f53 tempest-VolumesMetadataTest-481119197 None] Lock "cinder-cb78e3b6-2532-4576-b591-a2cd365e1d7d-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Flow 'volume_create_manager' (54eca8ad-9f9c-4ec0-a782-7188f5cf556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c27a7c-9213-47ba-84a9-99196e9b8676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=186,cinder:UPDATE=196,cinder:DELETE=14,cinder:INSERT=69 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c27a7c-9213-47ba-84a9-99196e9b8676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1591989277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffa5885-013e-4356-9be7-28ff8e1452f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403222fd3bdc48db96a8fb3e8de5228d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:20Z,use_quota=True,user_id='e2925baa7b3b4d5b99e4194b0670b056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f36be51-fed1-45ef-a553-59471a2a6616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f36be51-fed1-45ef-a553-59471a2a6616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5b0af9-1d6f-4a40-8eed-7d41a40f35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5b0af9-1d6f-4a40-8eed-7d41a40f35d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffa5885-013e-4356-9be7-28ff8e1452f5', 'volume_name': 'volume-7ffa5885-013e-4356-9be7-28ff8e1452f5', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fdd787-04a1-4671-bee3-dc921ccf576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fdd787-04a1-4671-bee3-dc921ccf576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28b7c4a-6467-422b-b46c-59b1a8c41372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Volume 7ffa5885-013e-4356-9be7-28ff8e1452f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffa5885-013e-4356-9be7-28ff8e1452f5', 'volume_size': 1} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1591989277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffa5885-013e-4356-9be7-28ff8e1452f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403222fd3bdc48db96a8fb3e8de5228d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:20Z,use_quota=True,user_id='e2925baa7b3b4d5b99e4194b0670b056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Creating volume 7ffa5885-013e-4356-9be7-28ff8e1452f5 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:19 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 1073741824 Jul 21 17:22:19 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:20 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 1073741824" returned: 0 in 0.500s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:20 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 Jul 21 17:22:20 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:20 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28b7c4a-6467-422b-b46c-59b1a8c41372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffa5885-013e-4356-9be7-28ff8e1452f5', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756b4987-f664-417c-9885-082839c043b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Volume volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 (7ffa5885-013e-4356-9be7-28ff8e1452f5): created successfully Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756b4987-f664-417c-9885-082839c043b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Flow 'volume_create_manager' (54eca8ad-9f9c-4ec0-a782-7188f5cf556d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-eb50dda2-8807-41d8-9ff3-f6074a53e019 tempest-VolumesTransfersV355Test-1018669046 None] Created volume successfully. Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Flow 'volume_create_manager' (a87ed53c-9a97-4f65-92f4-2c6454b3728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1266c562-5d20-4363-b4a7-735d573ba4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1266c562-5d20-4363-b4a7-735d573ba4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1615589804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b1a77a-1aea-44b0-a298-34d687376299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28d968180e34b66907a0027ac42b34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:23Z,use_quota=True,user_id='85f476f60eb74b63b78381ddd492ad1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fc8ef6-c124-444e-bf67-5911677e4a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fc8ef6-c124-444e-bf67-5911677e4a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f14a5-d0ed-4a53-9484-06e06ee398a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f14a5-d0ed-4a53-9484-06e06ee398a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b1a77a-1aea-44b0-a298-34d687376299', 'volume_name': 'volume-73b1a77a-1aea-44b0-a298-34d687376299', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbb3a3b-c450-4c57-ba01-a46ddb512885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbb3a3b-c450-4c57-ba01-a46ddb512885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9237d8f3-5f96-4ea7-928a-ea0669609756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:22 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Volume 73b1a77a-1aea-44b0-a298-34d687376299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b1a77a-1aea-44b0-a298-34d687376299', 'volume_size': 1} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1615589804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b1a77a-1aea-44b0-a298-34d687376299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28d968180e34b66907a0027ac42b34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:23Z,use_quota=True,user_id='85f476f60eb74b63b78381ddd492ad1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Creating volume 73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:22 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:22 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 1073741824 Jul 21 17:22:22 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d13e3ab1-3309-48cc-8f3a-239fb649f8b8 tempest-VolumesTransfersV355Test-1010377025 None] Transfer volume completed successfully. Jul 21 17:22:23 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 1073741824" returned: 0 in 0.864s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Acquiring lock "cinder-7ffa5885-013e-4356-9be7-28ff8e1452f5-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:23 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:22:23 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-7ffa5885-013e-4356-9be7-28ff8e1452f5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Acquiring lock "cinder-quobyte-7ffa5885-013e-4356-9be7-28ff8e1452f5" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-quobyte-7ffa5885-013e-4356-9be7-28ff8e1452f5" acquired by "delete_volume" :: waited 0.062s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd3c615-351e-42f3-b862-35fcdf15640d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:24 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 Jul 21 17:22:24 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:24 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.515s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9237d8f3-5f96-4ea7-928a-ea0669609756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b1a77a-1aea-44b0-a298-34d687376299', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7912b5-6e8e-4cd0-a1a2-46b6438d099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Volume volume-73b1a77a-1aea-44b0-a298-34d687376299 (73b1a77a-1aea-44b0-a298-34d687376299): created successfully Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7912b5-6e8e-4cd0-a1a2-46b6438d099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Flow 'volume_create_manager' (a87ed53c-9a97-4f65-92f4-2c6454b3728f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d08b740c-3fa7-487a-a1cf-2111a95c3c04 tempest-VolumesActionsTest-883004062 None] Created volume successfully. Jul 21 17:22:24 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5" returned: 0 in 0.637s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:24 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5 Jul 21 17:22:24 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:25 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7ffa5885-013e-4356-9be7-28ff8e1452f5" returned: 0 in 0.437s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-quobyte-7ffa5885-013e-4356-9be7-28ff8e1452f5" released by "delete_volume" :: held 1.176s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Created reservations ['10e14546-2dd4-4cd0-a7c0-b301d5ff3dc7', '3f68ad52-2506-4326-92a3-935f708ac709', '61763ec9-9c6a-40f1-8338-0e69efff8af4', '26f8947f-d6dc-482a-9dce-a69704cc025a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:25 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:25 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:25 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Deleted volume successfully. Jul 21 17:22:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f7c6696e-5ffb-4d14-b096-5e19fe411cb7 tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-7ffa5885-013e-4356-9be7-28ff8e1452f5-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-1709b114-efa2-4d95-876d-f3d52c093111 req-dfa26592-5f16-4b78-90cc-3aee33f23977 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-1709b114-efa2-4d95-876d-f3d52c093111 req-dfa26592-5f16-4b78-90cc-3aee33f23977 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-1709b114-efa2-4d95-876d-f3d52c093111 req-dfa26592-5f16-4b78-90cc-3aee33f23977 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-1709b114-efa2-4d95-876d-f3d52c093111 req-dfa26592-5f16-4b78-90cc-3aee33f23977 tempest-TestInstancesWithCinderVolumes-1578686119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2505102e-2284-46ff-9936-c1a17f3ce66b', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:22:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-1709b114-efa2-4d95-876d-f3d52c093111 req-dfa26592-5f16-4b78-90cc-3aee33f23977 tempest-TestInstancesWithCinderVolumes-1578686119 None] attachment_update completed successfully. Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Flow 'volume_create_manager' (77bf56b5-8b2a-45a3-ae9b-397187b074a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53995c7a-cd0b-489b-aff7-a3fbfe439ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53995c7a-cd0b-489b-aff7-a3fbfe439ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1226567737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5aa3c83-6983-40f6-bfeb-781ede6c1995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403222fd3bdc48db96a8fb3e8de5228d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:27Z,use_quota=True,user_id='e2925baa7b3b4d5b99e4194b0670b056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f601be8d-733d-4458-9b14-0bf20a654d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f601be8d-733d-4458-9b14-0bf20a654d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8373ad2-b559-4ed6-b37c-bb6a7fd37956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8373ad2-b559-4ed6-b37c-bb6a7fd37956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5aa3c83-6983-40f6-bfeb-781ede6c1995', 'volume_name': 'volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f929f6b-8ebf-491e-aabd-9e00a32bdffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f929f6b-8ebf-491e-aabd-9e00a32bdffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dbdd08-7caf-48d0-a5d5-cb04d959c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Volume d5aa3c83-6983-40f6-bfeb-781ede6c1995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995', 'volume_size': 1} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1226567737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5aa3c83-6983-40f6-bfeb-781ede6c1995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403222fd3bdc48db96a8fb3e8de5228d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:27Z,use_quota=True,user_id='e2925baa7b3b4d5b99e4194b0670b056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Creating volume d5aa3c83-6983-40f6-bfeb-781ede6c1995 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:27 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:27 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 1073741824 Jul 21 17:22:27 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:27 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 1073741824" returned: 0 in 0.507s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:27 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 Jul 21 17:22:27 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:27 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dbdd08-7caf-48d0-a5d5-cb04d959c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d72394b-d162-496e-b61a-ccb330b6ce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Volume volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 (d5aa3c83-6983-40f6-bfeb-781ede6c1995): created successfully Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d72394b-d162-496e-b61a-ccb330b6ce6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Flow 'volume_create_manager' (77bf56b5-8b2a-45a3-ae9b-397187b074a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:27 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=144,cinder:SELECT=123,cinder:DELETE=9,cinder:INSERT=35 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:22:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8671a5e9-eb7d-49e2-9efb-93cfeb59d312 tempest-VolumesTransfersV355Test-1018669046 None] Created volume successfully. Jul 21 17:22:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Acquiring lock "cinder-d5aa3c83-6983-40f6-bfeb-781ede6c1995-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-d5aa3c83-6983-40f6-bfeb-781ede6c1995-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Acquiring lock "cinder-quobyte-d5aa3c83-6983-40f6-bfeb-781ede6c1995" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-quobyte-d5aa3c83-6983-40f6-bfeb-781ede6c1995" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[556af083-c0ea-4861-9422-9a9b0dc4e9ed]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:29 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 Jul 21 17:22:29 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:30 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995" returned: 0 in 0.625s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:30 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995 Jul 21 17:22:30 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:30 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d5aa3c83-6983-40f6-bfeb-781ede6c1995" returned: 0 in 0.382s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-quobyte-d5aa3c83-6983-40f6-bfeb-781ede6c1995" released by "delete_volume" :: held 1.104s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Created reservations ['8868d5fd-8a54-4606-b212-e4a73d1f6621', 'b84a9135-fc7c-4c1a-a25b-b55bce62d1b3', 'e29ee7cc-35d6-477c-b7fa-10c39676e009', '2a3243fe-f510-4e21-966f-d6b00aec4a9a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:30 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:30 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:31 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.712s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:31 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Deleted volume successfully. Jul 21 17:22:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e5bc4777-1546-4fd5-b769-6c3e3c6b421c tempest-VolumesTransfersV355Test-1963999957 None] Lock "cinder-d5aa3c83-6983-40f6-bfeb-781ede6c1995-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:40 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:22:41 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:42 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:42 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:42 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.627s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:22:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:22:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a1827471-b9c8-4104-a944-03bdaa82ba99 tempest-VolumesActionsTest-883004062 None] Acquiring lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299" by "attach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a1827471-b9c8-4104-a944-03bdaa82ba99 tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299" acquired by "attach_volume" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a1827471-b9c8-4104-a944-03bdaa82ba99 tempest-VolumesActionsTest-883004062 None] Attaching volume 73b1a77a-1aea-44b0-a298-34d687376299 to instance 064bfde0-de93-4b7b-b7fb-956129b49c42 at mountpoint /dev/vdb on host None. Jul 21 17:22:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a1827471-b9c8-4104-a944-03bdaa82ba99 tempest-VolumesActionsTest-883004062 None] Attach volume completed successfully. Jul 21 17:22:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a1827471-b9c8-4104-a944-03bdaa82ba99 tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299" released by "attach_volume" :: held 0.235s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-65b69945-fcba-400a-8fe6-3a0910c2a11b tempest-VolumesActionsTest-883004062 None] Acquiring lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-detach_volume" by "detach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-65b69945-fcba-400a-8fe6-3a0910c2a11b tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-65b69945-fcba-400a-8fe6-3a0910c2a11b tempest-VolumesActionsTest-883004062 None] Detaching volume 73b1a77a-1aea-44b0-a298-34d687376299 from instance 064bfde0-de93-4b7b-b7fb-956129b49c42. Jul 21 17:22:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-65b69945-fcba-400a-8fe6-3a0910c2a11b tempest-VolumesActionsTest-883004062 None] Detach volume completed successfully. Jul 21 17:22:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-65b69945-fcba-400a-8fe6-3a0910c2a11b tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-detach_volume" released by "detach_volume" :: held 0.243s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (3e131d91-5a03-4c29-b21c-dde4ec398b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f91427-4024-4010-9923-e2316e6618e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f91427-4024-4010-9923-e2316e6618e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-455043084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd182f7c-be10-47bd-bb34-4a35e101486f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:48Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e04d94-a5d4-43fd-a8c1-6b2aaddb0328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e04d94-a5d4-43fd-a8c1-6b2aaddb0328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd62f51-7353-4080-8361-661a18341115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd62f51-7353-4080-8361-661a18341115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd182f7c-be10-47bd-bb34-4a35e101486f', 'volume_name': 'volume-dd182f7c-be10-47bd-bb34-4a35e101486f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5a07a8-51d2-4dcc-a041-ce5194a5ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5a07a8-51d2-4dcc-a041-ce5194a5ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43ec265-a669-4b2b-b081-9afb4968f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Volume dd182f7c-be10-47bd-bb34-4a35e101486f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd182f7c-be10-47bd-bb34-4a35e101486f', 'volume_size': 1} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-455043084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd182f7c-be10-47bd-bb34-4a35e101486f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:48Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Creating volume dd182f7c-be10-47bd-bb34-4a35e101486f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:48 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:48 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f 1073741824 Jul 21 17:22:48 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:49 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f 1073741824" returned: 0 in 0.714s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:49 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f Jul 21 17:22:49 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:49 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f" returned: 0 in 0.423s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43ec265-a669-4b2b-b081-9afb4968f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd182f7c-be10-47bd-bb34-4a35e101486f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fed364-6c10-4072-a4fc-ce9a414a6433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:49 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Volume volume-dd182f7c-be10-47bd-bb34-4a35e101486f (dd182f7c-be10-47bd-bb34-4a35e101486f): created successfully Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fed364-6c10-4072-a4fc-ce9a414a6433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (3e131d91-5a03-4c29-b21c-dde4ec398b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-85703135-36d0-412a-9647-e0e319300611 tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (fe2fe8c2-64ce-468c-86a5-94e525bc7f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ad708f-f74b-41b6-873c-5ec370e597de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ad708f-f74b-41b6-873c-5ec370e597de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1221806051',display_name='tempest-VolumesGetTest-Volume-133634770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f269ec9-9b36-4992-a40d-ee2e684b63e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:53Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e61f04c-1dfa-4fba-ac77-3e67b53a8963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e61f04c-1dfa-4fba-ac77-3e67b53a8963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44f4e9-37bf-4bc8-9b3c-add74b22d4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44f4e9-37bf-4bc8-9b3c-add74b22d4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f269ec9-9b36-4992-a40d-ee2e684b63e3', 'volume_name': 'volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6752f78-8231-4155-8918-ac409e116b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6752f78-8231-4155-8918-ac409e116b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144d64fc-b00a-4ddb-bbaf-869256b431c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Volume 4f269ec9-9b36-4992-a40d-ee2e684b63e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3', 'volume_size': 1} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1221806051',display_name='tempest-VolumesGetTest-Volume-133634770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f269ec9-9b36-4992-a40d-ee2e684b63e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:53Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Creating volume 4f269ec9-9b36-4992-a40d-ee2e684b63e3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:53 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:53 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 1073741824 Jul 21 17:22:53 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:53 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 1073741824" returned: 0 in 0.808s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:53 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 Jul 21 17:22:53 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:54 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3" returned: 0 in 0.464s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144d64fc-b00a-4ddb-bbaf-869256b431c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbf755f-a6c0-40cf-a0c8-c53b196c9ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Volume volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 (4f269ec9-9b36-4992-a40d-ee2e684b63e3): created successfully Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbf755f-a6c0-40cf-a0c8-c53b196c9ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (fe2fe8c2-64ce-468c-86a5-94e525bc7f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b5f4281c-092c-4ca8-8508-39b66bacc2ea tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-4f269ec9-9b36-4992-a40d-ee2e684b63e3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Lock "cinder-4f269ec9-9b36-4992-a40d-ee2e684b63e3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-4f269ec9-9b36-4992-a40d-ee2e684b63e3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-4f269ec9-9b36-4992-a40d-ee2e684b63e3" acquired by "delete_volume" :: waited 0.061s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[09441349-a6cb-4e0d-8721-97349611c7e7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (64b4a047-d139-493a-95b4-a3f9abd309d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03ba190-4de9-4003-9ca8-8f3bc7dd2d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03ba190-4de9-4003-9ca8-8f3bc7dd2d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363320701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea651a4-28dc-4f6e-b3a7-f347ebc238bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:55Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d28243-7d18-4beb-9136-7d45f8ac2df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d28243-7d18-4beb-9136-7d45f8ac2df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f918a78-5295-425d-a518-7b24966ad8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f918a78-5295-425d-a518-7b24966ad8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea651a4-28dc-4f6e-b3a7-f347ebc238bc', 'volume_name': 'volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:55 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 Jul 21 17:22:55 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b424768-c286-41f6-9f60-a5cd95ea3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b424768-c286-41f6-9f60-a5cd95ea3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625b5b78-31a2-4eb3-b8fe-68923accef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Volume 8ea651a4-28dc-4f6e-b3a7-f347ebc238bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc', 'volume_size': 1} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363320701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea651a4-28dc-4f6e-b3a7-f347ebc238bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:22:55Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Creating volume 8ea651a4-28dc-4f6e-b3a7-f347ebc238bc {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:22:55 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:22:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:55 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc 1073741824 Jul 21 17:22:55 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:56 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3" returned: 0 in 0.771s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:56 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3 Jul 21 17:22:56 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:56 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc 1073741824" returned: 0 in 0.805s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:56 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4f269ec9-9b36-4992-a40d-ee2e684b63e3" returned: 0 in 0.346s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-4f269ec9-9b36-4992-a40d-ee2e684b63e3" released by "delete_volume" :: held 1.227s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:56 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc Jul 21 17:22:56 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Created reservations ['b69977a6-6ffa-44ab-a4a9-c11c1db93041', '104d9101-c5d2-468c-b117-ca738d7debb1', '7a0ded2b-7a1d-4fbf-ba46-a01fc8e70643', '66e34625-d43b-4c0f-a93d-a9b059cf2a8e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:56 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:56 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:56 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" returned: 0 in 0.545s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:22:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625b5b78-31a2-4eb3-b8fe-68923accef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d275b68-cc58-4dc4-a2bf-dfd4d3cd7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:22:57 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.443s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:22:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Volume volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc (8ea651a4-28dc-4f6e-b3a7-f347ebc238bc): created successfully Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d275b68-cc58-4dc4-a2bf-dfd4d3cd7d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (64b4a047-d139-493a-95b4-a3f9abd309d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:22:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:22:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ac400f19-4de4-4ba4-b586-c24b2d8f2c00 tempest-VolumesActionsTest-852452289 None] Created volume successfully. Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ee103303-0a59-455d-a7e2-82fc3db8526d tempest-VolumesActionsTest-852452289 None] Acquiring lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" by "attach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e3118334-9203-4923-a99e-3eaa59041265 tempest-VolumesGetTest-1021308160 None] Lock "cinder-4f269ec9-9b36-4992-a40d-ee2e684b63e3-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ee103303-0a59-455d-a7e2-82fc3db8526d tempest-VolumesActionsTest-852452289 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" acquired by "attach_volume" :: waited 0.045s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ee103303-0a59-455d-a7e2-82fc3db8526d tempest-VolumesActionsTest-852452289 None] Attaching volume 8ea651a4-28dc-4f6e-b3a7-f347ebc238bc to instance e8e0e283-ed91-48f4-9eb9-12e17e283065 at mountpoint /dev/vdb on host None. Jul 21 17:22:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ee103303-0a59-455d-a7e2-82fc3db8526d tempest-VolumesActionsTest-852452289 None] Attach volume completed successfully. Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ee103303-0a59-455d-a7e2-82fc3db8526d tempest-VolumesActionsTest-852452289 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" released by "attach_volume" :: held 0.139s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-dd182f7c-be10-47bd-bb34-4a35e101486f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Lock "cinder-dd182f7c-be10-47bd-bb34-4a35e101486f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-dd182f7c-be10-47bd-bb34-4a35e101486f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-dd182f7c-be10-47bd-bb34-4a35e101486f" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c953084-7b10-4713-8801-b7ab19896cb2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:22:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:58 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f Jul 21 17:22:58 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-21df1b12-eeec-4778-8b2d-d405d2d4c44a tempest-VolumesActionsTest-1145425151 None] Terminate volume connection completed successfully. Jul 21 17:22:58 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f" returned: 0 in 0.804s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:58 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f Jul 21 17:22:58 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-21df1b12-eeec-4778-8b2d-d405d2d4c44a tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-detach_volume" by "detach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-21df1b12-eeec-4778-8b2d-d405d2d4c44a tempest-VolumesActionsTest-1145425151 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-21df1b12-eeec-4778-8b2d-d405d2d4c44a tempest-VolumesActionsTest-1145425151 None] Detaching volume 8ea651a4-28dc-4f6e-b3a7-f347ebc238bc from instance e8e0e283-ed91-48f4-9eb9-12e17e283065. Jul 21 17:22:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-21df1b12-eeec-4778-8b2d-d405d2d4c44a tempest-VolumesActionsTest-1145425151 None] Detach volume completed successfully. Jul 21 17:22:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-21df1b12-eeec-4778-8b2d-d405d2d4c44a tempest-VolumesActionsTest-1145425151 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-detach_volume" released by "detach_volume" :: held 0.248s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96f2585f-4658-44fd-be82-5c764d1d407f tempest-VolumesActionsTest-852452289 None] Acquiring lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-detach_volume" by "detach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:59 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dd182f7c-be10-47bd-bb34-4a35e101486f" returned: 0 in 0.759s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96f2585f-4658-44fd-be82-5c764d1d407f tempest-VolumesActionsTest-852452289 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:22:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-96f2585f-4658-44fd-be82-5c764d1d407f tempest-VolumesActionsTest-852452289 None] Volume detach called, but volume not attached. Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-dd182f7c-be10-47bd-bb34-4a35e101486f" released by "delete_volume" :: held 1.684s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96f2585f-4658-44fd-be82-5c764d1d407f tempest-VolumesActionsTest-852452289 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Created reservations ['d712951e-e4ad-40cd-bbc5-3edd29d5720e', '314d25a2-0890-4e14-885a-38273be849dd', '7a9905fe-ee1e-4927-a9b5-cef24599620c', '0cd5875b-ecb4-43bc-aaf8-fbdc1fcca668'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:22:59 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:22:59 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Acquiring lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:22:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Acquiring lock "cinder-quobyte-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Lock "cinder-quobyte-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" acquired by "delete_volume" :: waited 0.077s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848da7c-6775-4874-a35c-b92fa3926e90]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:00 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.664s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:23:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c8c8a4a9-baa3-4d2a-8974-8e029da00056 tempest-VolumesGetTest-1021308160 None] Lock "cinder-dd182f7c-be10-47bd-bb34-4a35e101486f-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:00 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc Jul 21 17:23:00 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:01 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" returned: 0 in 0.897s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:01 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc Jul 21 17:23:01 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (f5f5717d-5356-404a-b194-9346b6e07056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42bc009-8959-47ec-aa38-d9cc6d1686a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42bc009-8959-47ec-aa38-d9cc6d1686a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-581022969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84beb7d1-8a0a-493f-8328-adb58f381edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:01Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cb6512-0804-4d07-ae03-810325b72cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cb6512-0804-4d07-ae03-810325b72cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22955338-1bc5-45f3-958b-41d28195d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22955338-1bc5-45f3-958b-41d28195d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84beb7d1-8a0a-493f-8328-adb58f381edb', 'volume_name': 'volume-84beb7d1-8a0a-493f-8328-adb58f381edb', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363fd9d-ac49-40c1-af59-4a47bd6d8013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363fd9d-ac49-40c1-af59-4a47bd6d8013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef995b3-6c2f-45bb-b88d-25ef45bcb76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:01 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Volume 84beb7d1-8a0a-493f-8328-adb58f381edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84beb7d1-8a0a-493f-8328-adb58f381edb', 'volume_size': 1} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-581022969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84beb7d1-8a0a-493f-8328-adb58f381edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:01Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Creating volume 84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:23:01 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:23:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:01 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb 1073741824 Jul 21 17:23:01 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:01 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" returned: 0 in 0.881s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Lock "cinder-quobyte-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc" released by "delete_volume" :: held 1.922s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Created reservations ['2a535bf4-ed25-4c88-b648-ed23240efeda', '0fa90656-b99b-43c7-b908-da237d436e10', '741c4489-2ff8-420e-a5ae-5cf93580e3e9', 'c0bef1d1-8068-4d13-93c9-f26ebc2fbd84'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:02 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:02 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:02 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb 1073741824" returned: 0 in 1.320s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:03 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:03 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:03 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.693s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Deleted volume successfully. Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1017b60f-c092-49de-b421-cc2ea49b3fdf tempest-VolumesActionsTest-852452289 None] Lock "cinder-8ea651a4-28dc-4f6e-b3a7-f347ebc238bc-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:03 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 0.893s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef995b3-6c2f-45bb-b88d-25ef45bcb76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84beb7d1-8a0a-493f-8328-adb58f381edb', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f945ff3d-16ef-4793-aa09-c98919e1229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Volume volume-84beb7d1-8a0a-493f-8328-adb58f381edb (84beb7d1-8a0a-493f-8328-adb58f381edb): created successfully Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f945ff3d-16ef-4793-aa09-c98919e1229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (f5f5717d-5356-404a-b194-9346b6e07056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:04 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-71a2c917-f3ca-4a42-a744-1c964916197a tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:23:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9d1a41fb-45ff-45a3-bd74-d1875880ba22 tempest-VolumesActionsTest-883004062 None] Acquiring lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299" by "attach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9d1a41fb-45ff-45a3-bd74-d1875880ba22 tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299" acquired by "attach_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:05 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9d1a41fb-45ff-45a3-bd74-d1875880ba22 tempest-VolumesActionsTest-883004062 None] Attaching volume 73b1a77a-1aea-44b0-a298-34d687376299 to instance 3528be2b-b9f8-43da-9a64-11465afa4315 at mountpoint /dev/vdb on host None. Jul 21 17:23:05 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9d1a41fb-45ff-45a3-bd74-d1875880ba22 tempest-VolumesActionsTest-883004062 None] Attach volume completed successfully. Jul 21 17:23:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9d1a41fb-45ff-45a3-bd74-d1875880ba22 tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299" released by "attach_volume" :: held 0.297s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (8dfb78b9-d343-4d9c-9949-a3e6c187bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a7bcd-b2d5-4ad1-81b2-13f40ffdb946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-f2bea31a-68e2-4390-81c5-258860e68c59 req-6ae01236-8fd4-4136-978c-91851b8bb854 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-f2bea31a-68e2-4390-81c5-258860e68c59 req-6ae01236-8fd4-4136-978c-91851b8bb854 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a7bcd-b2d5-4ad1-81b2-13f40ffdb946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1632780059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a997ea-1959-4910-8f2a-b81cc2e8e600,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=84beb7d1-8a0a-493f-8328-adb58f381edb,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:06Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e733ec67-577a-4a41-9bb1-82791ae6299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e733ec67-577a-4a41-9bb1-82791ae6299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b0ffd0-a14a-477e-826c-f32c2b17ae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-f2bea31a-68e2-4390-81c5-258860e68c59 req-6ae01236-8fd4-4136-978c-91851b8bb854 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b0ffd0-a14a-477e-826c-f32c2b17ae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a7a997ea-1959-4910-8f2a-b81cc2e8e600', 'volume_name': 'volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600', 'volume_size': 1, 'source_volid': '84beb7d1-8a0a-493f-8328-adb58f381edb', 'source_volstatus': 'available'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf5c4a0-b4ae-4227-b825-3db351755f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf5c4a0-b4ae-4227-b825-3db351755f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21250473-b444-41fb-96da-5e8d2f636c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:06 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Volume a7a997ea-1959-4910-8f2a-b81cc2e8e600: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600', 'volume_size': 1, 'source_volid': '84beb7d1-8a0a-493f-8328-adb58f381edb', 'source_volstatus': 'available'} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:06 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Cloning volume 84beb7d1-8a0a-493f-8328-adb58f381edb to volume a7a997ea-1959-4910-8f2a-b81cc2e8e600 Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c0566269-32c5-4526-b62c-61dc4de28600 tempest-VolumesActionsTest-883004062 None] Acquiring lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-detach_volume" by "detach_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-f2bea31a-68e2-4390-81c5-258860e68c59 req-6ae01236-8fd4-4136-978c-91851b8bb854 tempest-TestInstancesWithCinderVolumes-1578686119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-55739145-2df8-40fe-8c8a-9f4f457363e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46731b0e-5ade-42da-babe-ae1fefda9202', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c0566269-32c5-4526-b62c-61dc4de28600 tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c0566269-32c5-4526-b62c-61dc4de28600 tempest-VolumesActionsTest-883004062 None] Detaching volume 73b1a77a-1aea-44b0-a298-34d687376299 from instance 3528be2b-b9f8-43da-9a64-11465afa4315. Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Creating offline snapshot d3050eba-9097-4a68-bb48-d7a7b53edcba of volume 84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5177573-ce3e-4ff7-9ce4-6263c98f9772]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-f2bea31a-68e2-4390-81c5-258860e68c59 req-6ae01236-8fd4-4136-978c-91851b8bb854 tempest-TestInstancesWithCinderVolumes-1578686119 None] attachment_update completed successfully. Jul 21 17:23:06 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:06 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c0566269-32c5-4526-b62c-61dc4de28600 tempest-VolumesActionsTest-883004062 None] Detach volume completed successfully. Jul 21 17:23:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c0566269-32c5-4526-b62c-61dc4de28600 tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-detach_volume" released by "detach_volume" :: held 0.295s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:07 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 0.771s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:07 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba 1G Jul 21 17:23:07 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:08 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba 1G" returned: 0 in 0.779s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84beb7d1-8a0a-493f-8328-adb58f381edb -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:08 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84beb7d1-8a0a-493f-8328-adb58f381edb -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba Jul 21 17:23:08 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (087823ca-cd3f-4ab3-b2f5-0d5871f9f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5def9371-317c-4e47-82f2-f8d4d73a7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5def9371-317c-4e47-82f2-f8d4d73a7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1943566877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d532a9-ebbc-4657-b59d-f0d593f9a9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:08Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279b6e75-b731-46c5-aecb-9146347d260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279b6e75-b731-46c5-aecb-9146347d260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e46ac81-f5cc-40cd-9dec-06b5e5194e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e46ac81-f5cc-40cd-9dec-06b5e5194e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d532a9-ebbc-4657-b59d-f0d593f9a9d4', 'volume_name': 'volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1aba387-82b5-4f47-8926-504b31343739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1aba387-82b5-4f47-8926-504b31343739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141d5bbf-3cbb-4ccd-83f8-f5ebf67a13d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:08 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Volume 06d532a9-ebbc-4657-b59d-f0d593f9a9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4', 'volume_size': 1} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:08 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84beb7d1-8a0a-493f-8328-adb58f381edb -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba" returned: 0 in 0.404s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:08 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba is being set with open permissions: ugo+rw Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:08 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba Jul 21 17:23:08 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:08 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba" returned: 0 in 0.352s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:08 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info Jul 21 17:23:08 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:09 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:09 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info is being set with open permissions: ugo+rw Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:09 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info Jul 21 17:23:09 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:09 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.info" returned: 0 in 0.275s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-a7a997ea-1959-4910-8f2a-b81cc2e8e600" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-a7a997ea-1959-4910-8f2a-b81cc2e8e600" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] snapshot: d3050eba-9097-4a68-bb48-d7a7b53edcba, volume: a7a997ea-1959-4910-8f2a-b81cc2e8e600, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e718b8f-0785-4ed2-a0d8-760f6865c3ac]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-c6b1ab20-2221-45f6-a739-e6caf0807acd req-499f1c04-3865-481a-8c34-40d497ead472 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:09 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba Jul 21 17:23:09 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:09 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84beb7d1-8a0a-493f-8328-adb58f381edb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad68b064-cbc3-4cd1-9a76-ab28ffacb2d0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:10 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:10 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:10 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 0.381s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:10 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:23:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:10 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 Jul 21 17:23:10 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:14 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600" returned: 0 in 4.404s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d031fc-80a2-47b1-ba43-6dc6af98ebea]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:14 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:14 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:15 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 0.508s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:23:15 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Converted 1024.00 MB image at 232.45 MB/s Jul 21 17:23:15 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 is being set with open permissions: ugo+rw Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:15 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 Jul 21 17:23:15 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:15 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600" returned: 0 in 0.233s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-a7a997ea-1959-4910-8f2a-b81cc2e8e600" released by "_copy_volume_from_snapshot" :: held 5.966s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-d3050eba-9097-4a68-bb48-d7a7b53edcba" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-d3050eba-9097-4a68-bb48-d7a7b53edcba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Deleting offline snapshot d3050eba-9097-4a68-bb48-d7a7b53edcba of volume 84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] snapshot_file for this snap is: volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[773c2812-7689-4d9a-ace1-b1df05e9c50c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:15 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba Jul 21 17:23:15 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:15 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba" returned: 0 in 0.344s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84beb7d1-8a0a-493f-8328-adb58f381edb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e745c94-f3c6-4f3a-b4d1-b9a6c3b380e9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:16 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:16 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:16 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:16 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba Jul 21 17:23:16 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:16 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba" returned: 0 in 0.333s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:16 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba Jul 21 17:23:16 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:16 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb.d3050eba-9097-4a68-bb48-d7a7b53edcba" returned: 0 in 0.246s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-d3050eba-9097-4a68-bb48-d7a7b53edcba" released by "_delete_snapshot" :: held 1.347s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.560s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.593s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1943566877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d532a9-ebbc-4657-b59d-f0d593f9a9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:08Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Creating volume 06d532a9-ebbc-4657-b59d-f0d593f9a9d4 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:23:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:16 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 1073741824 Jul 21 17:23:16 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21250473-b444-41fb-96da-5e8d2f636c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600', 'volume_size': 1, 'source_volid': '84beb7d1-8a0a-493f-8328-adb58f381edb', 'source_volstatus': 'available'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b93643-3103-419a-8d5d-08f765cecd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Volume volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 (a7a997ea-1959-4910-8f2a-b81cc2e8e600): created successfully Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b93643-3103-419a-8d5d-08f765cecd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (8dfb78b9-d343-4d9c-9949-a3e6c187bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-98a67ae2-8630-4cca-8fd6-f8f614bb71a9 tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:23:17 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 1073741824" returned: 0 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:17 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 Jul 21 17:23:17 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:17 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-c6b1ab20-2221-45f6-a739-e6caf0807acd req-499f1c04-3865-481a-8c34-40d497ead472 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141d5bbf-3cbb-4ccd-83f8-f5ebf67a13d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016020ae-b87d-46ed-85f2-804f16f76189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-c6b1ab20-2221-45f6-a739-e6caf0807acd req-499f1c04-3865-481a-8c34-40d497ead472 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.652s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Volume volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 (06d532a9-ebbc-4657-b59d-f0d593f9a9d4): created successfully Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016020ae-b87d-46ed-85f2-804f16f76189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (087823ca-cd3f-4ab3-b2f5-0d5871f9f986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ddef9-efc5-4a7a-b7d7-aacac4159e6b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c1c86104-fedf-4b18-ba22-affca36bec62 tempest-VolumesActionsTest-852452289 None] Created volume successfully. Jul 21 17:23:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-c6b1ab20-2221-45f6-a739-e6caf0807acd req-499f1c04-3865-481a-8c34-40d497ead472 tempest-TestInstancesWithCinderVolumes-1578686119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-9431ed45-6dbf-462d-9104-17a19f77c80d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c721b4bb-85a9-426c-9890-844a5da98ac8', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:23:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-c6b1ab20-2221-45f6-a739-e6caf0807acd req-499f1c04-3865-481a-8c34-40d497ead472 tempest-TestInstancesWithCinderVolumes-1578686119 None] attachment_update completed successfully. Jul 21 17:23:17 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:23:17 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:18 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.420s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd260fd-31ec-4979-8892-273e1d50ff41]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:18 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:23:18 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (7a5ce7e0-c4a6-4386-92be-44488e114f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5268ef0-b126-4fb5-8c96-aa6f2f02473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5268ef0-b126-4fb5-8c96-aa6f2f02473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1980933627',display_name='tempest-VolumesGetTest-Volume-1759752536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69eb1031-f992-4a08-b4c7-7b01f8ce8613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:18Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46429d0-2f3a-4a94-b5f9-6cbe35d188a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46429d0-2f3a-4a94-b5f9-6cbe35d188a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15af1f8-e86d-4c1c-a661-82dd8bca0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15af1f8-e86d-4c1c-a661-82dd8bca0540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69eb1031-f992-4a08-b4c7-7b01f8ce8613', 'volume_name': 'volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beba3b3f-e5b9-4f5c-88d5-97afa2522ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beba3b3f-e5b9-4f5c-88d5-97afa2522ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a103d04-c778-4739-ab76-c1123510ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Volume 69eb1031-f992-4a08-b4c7-7b01f8ce8613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613', 'volume_size': 1} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:18 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.440s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.3111ea2d-f780-4ad5-b4a0-f1512fdc3dfae5bg_v57.img {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:18 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.3111ea2d-f780-4ad5-b4a0-f1512fdc3dfae5bg_v57.img Jul 21 17:23:18 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-06d532a9-ebbc-4657-b59d-f0d593f9a9d4-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-06d532a9-ebbc-4657-b59d-f0d593f9a9d4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-quobyte-06d532a9-ebbc-4657-b59d-f0d593f9a9d4" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-06d532a9-ebbc-4657-b59d-f0d593f9a9d4" acquired by "delete_volume" :: waited 0.063s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767d254-3c74-4e02-9e35-eabe58ee8a37]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:19 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 Jul 21 17:23:19 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:19 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4" returned: 0 in 0.770s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:20 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4 Jul 21 17:23:20 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:20 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06d532a9-ebbc-4657-b59d-f0d593f9a9d4" returned: 0 in 0.488s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-06d532a9-ebbc-4657-b59d-f0d593f9a9d4" released by "delete_volume" :: held 1.345s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Created reservations ['ffb008e1-214e-4cb8-98d0-33c95de38a4d', '1216247d-414c-4c5a-b8ec-d9a5214df64f', '5de7e86c-c47d-47c0-9cd7-0e2eacc19cc2', '9c6fe473-054d-45c2-909e-5d6ecedd5837'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:20 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:20 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:21 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.694s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:21 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Deleted volume successfully. Jul 21 17:23:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a4511e81-ffa8-4fdd-b09b-761ee82c1475 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-06d532a9-ebbc-4657-b59d-f0d593f9a9d4-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (bb564d17-1c99-4f5d-85f2-bbe9a0e4315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdff26e-fbcf-40e6-862c-4d79329431f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdff26e-fbcf-40e6-862c-4d79329431f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1082760728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376cc86f-bc3c-4b12-a010-75ff0827cc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:23Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8b0c2b-df23-4268-86ba-3343895fcd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8b0c2b-df23-4268-86ba-3343895fcd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb404283-f9c2-4bd7-a6ed-4f29731e3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb404283-f9c2-4bd7-a6ed-4f29731e3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376cc86f-bc3c-4b12-a010-75ff0827cc87', 'volume_name': 'volume-376cc86f-bc3c-4b12-a010-75ff0827cc87', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644bc2f1-ca4d-4a7c-8555-99bba300aa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644bc2f1-ca4d-4a7c-8555-99bba300aa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9e3676-9191-4b6d-a3bf-c9982f4cdc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:22 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Volume 376cc86f-bc3c-4b12-a010-75ff0827cc87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376cc86f-bc3c-4b12-a010-75ff0827cc87', 'volume_size': 1} Jul 21 17:23:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:23 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.3111ea2d-f780-4ad5-b4a0-f1512fdc3dfae5bg_v57.img" returned: 0 in 5.213s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:23 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc7449-8efb-47d3-8532-33072815a205]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:23 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:23:23 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:24 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:24 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.3111ea2d-f780-4ad5-b4a0-f1512fdc3dfae5bg_v57.img {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:23:24 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Converted 1024.00 MB image at 196.42 MB/s Jul 21 17:23:24 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] 3111ea2d-f780-4ad5-b4a0-f1512fdc3dfa was raw, no need to convert to raw {{(pid=87591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 21 17:23:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-19990589-c57d-4798-9ef0-caba780fc1da req-046e86c6-f89f-4d03-beff-257f6eb1a834 tempest-TestInstancesWithCinderVolumes-1578686119 None] Terminate volume connection completed successfully. Jul 21 17:23:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-19990589-c57d-4798-9ef0-caba780fc1da req-046e86c6-f89f-4d03-beff-257f6eb1a834 tempest-TestInstancesWithCinderVolumes-1578686119 None] Deleting attachment 46731b0e-5ade-42da-babe-ae1fefda9202. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "cinder-55739145-2df8-40fe-8c8a-9f4f457363e8-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-55739145-2df8-40fe-8c8a-9f4f457363e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "cinder-quobyte-55739145-2df8-40fe-8c8a-9f4f457363e8" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-quobyte-55739145-2df8-40fe-8c8a-9f4f457363e8" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848e99a-757e-4761-a3ed-fc8bc63085e4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:25 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 Jul 21 17:23:25 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:25 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:25 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8 Jul 21 17:23:25 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:26 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-55739145-2df8-40fe-8c8a-9f4f457363e8" returned: 0 in 0.273s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-quobyte-55739145-2df8-40fe-8c8a-9f4f457363e8" released by "delete_volume" :: held 0.745s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:26 devstack cinder-volume[87591]: WARNING cinder.quota [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1130722709-1022729838 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1130722709-1022729838, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:23:26 devstack cinder-volume[87591]: WARNING cinder.quota [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1130722709-1022729838 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1130722709-1022729838, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Created reservations ['f496ef02-61b9-4612-ac72-442f465e7bec', '750d521c-1139-4ffb-b3f1-cf9b6b21ae03', '1310ddea-c8e2-4103-b5eb-0d4617735205', '57332c06-3c0f-4172-a91a-dd09ff6c2019'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:26 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:26 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:26 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.308s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Deleted volume successfully. Jul 21 17:23:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ef3b902e-53b1-47a5-9f81-2128250792af tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-55739145-2df8-40fe-8c8a-9f4f457363e8-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-560cc439-64e4-45f8-a9bf-0df2b81117bb req-3461b51b-0e83-4a85-86ed-1d58aa5807b1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Terminate volume connection completed successfully. Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-560cc439-64e4-45f8-a9bf-0df2b81117bb req-3461b51b-0e83-4a85-86ed-1d58aa5807b1 tempest-TestInstancesWithCinderVolumes-1578686119 None] Deleting attachment c721b4bb-85a9-426c-9890-844a5da98ac8. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "cinder-9431ed45-6dbf-462d-9104-17a19f77c80d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-9431ed45-6dbf-462d-9104-17a19f77c80d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "cinder-quobyte-9431ed45-6dbf-462d-9104-17a19f77c80d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-quobyte-9431ed45-6dbf-462d-9104-17a19f77c80d" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df785d-d5ae-49ad-9cd8-61dcdaf04cfa]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:30 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d Jul 21 17:23:30 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:30 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:30 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d Jul 21 17:23:30 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:30 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9431ed45-6dbf-462d-9104-17a19f77c80d" returned: 0 in 0.274s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-quobyte-9431ed45-6dbf-462d-9104-17a19f77c80d" released by "delete_volume" :: held 0.782s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:30 devstack cinder-volume[87591]: WARNING cinder.quota [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797471347-1669299884 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797471347-1669299884, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:23:30 devstack cinder-volume[87591]: WARNING cinder.quota [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797471347-1669299884 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797471347-1669299884, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Created reservations ['319537b6-b109-472b-b3f5-9d2f31521cfb', '241821f7-7d3a-4b1e-8f73-d108e89a269c', '10bceea4-b2a1-4c33-8c28-4c1f92385a55', 'a34ee7fa-3f12-4f11-9862-f4040c896843'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:30 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:30 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:31 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.304s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:31 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Deleted volume successfully. Jul 21 17:23:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0bd2241f-3af3-47bb-adb1-6318cbfcbc81 tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-9431ed45-6dbf-462d-9104-17a19f77c80d-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:34 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-6df9d212-6159-47c5-97fa-8a5af767e290 req-8795a10d-7ca4-442d-af15-2e10e0d82b21 tempest-TestInstancesWithCinderVolumes-1578686119 None] Terminate volume connection completed successfully. Jul 21 17:23:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-6df9d212-6159-47c5-97fa-8a5af767e290 req-8795a10d-7ca4-442d-af15-2e10e0d82b21 tempest-TestInstancesWithCinderVolumes-1578686119 None] Deleting attachment 2505102e-2284-46ff-9936-c1a17f3ce66b. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:23:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "cinder-a6fbfaec-ab2a-4eac-9913-c27972e51b5a-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-a6fbfaec-ab2a-4eac-9913-c27972e51b5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "cinder-quobyte-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-quobyte-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:35 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47abbc-1fc7-4f22-86f3-8397c1120026]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:35 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a Jul 21 17:23:35 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:36 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:36 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a Jul 21 17:23:36 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:36 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" returned: 0 in 0.281s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-quobyte-a6fbfaec-ab2a-4eac-9913-c27972e51b5a" released by "delete_volume" :: held 0.770s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:36 devstack cinder-volume[87591]: WARNING cinder.quota [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601203438-37916304 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601203438-37916304, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:23:36 devstack cinder-volume[87591]: WARNING cinder.quota [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601203438-37916304 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601203438-37916304, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Created reservations ['34b76e10-2494-4aa8-964b-47066f7cd676', '84a435e0-5d3b-4d00-9ea7-444e072ea821', 'bdf1402b-5e1f-4ef0-9862-867db2bb1de3', '79ad3d8b-2515-4175-8bd1-6d124ee59b0c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:36 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:36 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:36 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.267s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Deleted volume successfully. Jul 21 17:23:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e03a9688-f799-4179-a26a-10f477bc92ff tempest-TestInstancesWithCinderVolumes-1578686119 None] Lock "cinder-a6fbfaec-ab2a-4eac-9913-c27972e51b5a-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:42 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:42 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:42 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:23:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.546s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Uploaded volume to glance image-id: 3111ea2d-f780-4ad5-b4a0-f1512fdc3dfa. {{(pid=87591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.716s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1980933627',display_name='tempest-VolumesGetTest-Volume-1759752536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69eb1031-f992-4a08-b4c7-7b01f8ce8613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:18Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Creating volume 69eb1031-f992-4a08-b4c7-7b01f8ce8613 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:23:46 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=95,cinder:UPDATE=82,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=87,cinder:INSERT=20,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:23:46 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 1073741824 Jul 21 17:23:46 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d35262de-f925-4c30-8baf-c3cbdfad7f92 tempest-VolumesActionsTest-883004062 None] Copy volume to image completed successfully. Jul 21 17:23:46 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 1073741824" returned: 0 in 0.531s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:46 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 Jul 21 17:23:46 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:47 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.053s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1082760728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376cc86f-bc3c-4b12-a010-75ff0827cc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:23Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Creating volume 376cc86f-bc3c-4b12-a010-75ff0827cc87 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:23:47 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a103d04-c778-4739-ab76-c1123510ea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4707b1bf-e9ca-42a5-bb16-7def708d5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:47 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 1073741824 Jul 21 17:23:47 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:47 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Volume volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 (69eb1031-f992-4a08-b4c7-7b01f8ce8613): created successfully Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4707b1bf-e9ca-42a5-bb16-7def708d5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (7a5ce7e0-c4a6-4386-92be-44488e114f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-89324f0c-01f1-4111-98f5-3529a7f8cbe0 tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:47 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 1073741824" returned: 0 in 0.584s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:47 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 Jul 21 17:23:47 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-69eb1031-f992-4a08-b4c7-7b01f8ce8613-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Lock "cinder-69eb1031-f992-4a08-b4c7-7b01f8ce8613-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-69eb1031-f992-4a08-b4c7-7b01f8ce8613" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:47 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-69eb1031-f992-4a08-b4c7-7b01f8ce8613" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.352s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9e3676-9191-4b6d-a3bf-c9982f4cdc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376cc86f-bc3c-4b12-a010-75ff0827cc87', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0464aa07-7248-4514-989b-25c3611f1306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30f2f9-ef60-488a-990c-434558141f54]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d018ae-a2fa-4366-bea0-4b82447f3e52]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Volume volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 (376cc86f-bc3c-4b12-a010-75ff0827cc87): created successfully Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0464aa07-7248-4514-989b-25c3611f1306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (bb564d17-1c99-4f5d-85f2-bbe9a0e4315c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-31ef82db-6fac-4b3f-ad1d-984b12cdf3d2 tempest-VolumesActionsTest-852452289 None] Created volume successfully. Jul 21 17:23:48 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:23:48 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:48 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 Jul 21 17:23:48 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:48 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:48 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.455s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613" returned: 0 in 0.473s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1027b7-4630-42c2-8759-11c6495fedbd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:48 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613 Jul 21 17:23:48 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-376cc86f-bc3c-4b12-a010-75ff0827cc87-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-376cc86f-bc3c-4b12-a010-75ff0827cc87-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-quobyte-376cc86f-bc3c-4b12-a010-75ff0827cc87" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-376cc86f-bc3c-4b12-a010-75ff0827cc87" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:48 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:23:48 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955498d-9b4d-4439-872f-d929e1085ee7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:48 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 Jul 21 17:23:48 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:48 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-69eb1031-f992-4a08-b4c7-7b01f8ce8613" returned: 0 in 0.381s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-69eb1031-f992-4a08-b4c7-7b01f8ce8613" released by "delete_volume" :: held 0.916s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Created reservations ['45dcd777-dec3-4f2d-9065-bc573eaabcde', 'e3b3bfd6-2a4a-40a4-b2a3-8a3e2be16574', '1b5a37a6-3eac-4514-bd2c-ee3a48c06ed5', 'b235ed89-44e1-4d8d-8dd6-42054de87707'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:48 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.481s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:49 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img Jul 21 17:23:49 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:49 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:49 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:49 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87" returned: 0 in 0.504s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-a7a997ea-1959-4910-8f2a-b81cc2e8e600-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:49 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87 Jul 21 17:23:49 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Lock "cinder-a7a997ea-1959-4910-8f2a-b81cc2e8e600-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-a7a997ea-1959-4910-8f2a-b81cc2e8e600" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-a7a997ea-1959-4910-8f2a-b81cc2e8e600" acquired by "delete_volume" :: waited 0.078s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf11fda-4fd1-4c63-8be5-45408bc7030b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:49 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.541s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a7a0336a-5088-402c-9e84-15fe7508f352 tempest-VolumesGetTest-1021308160 None] Lock "cinder-69eb1031-f992-4a08-b4c7-7b01f8ce8613-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:49 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-376cc86f-bc3c-4b12-a010-75ff0827cc87" returned: 0 in 0.583s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-376cc86f-bc3c-4b12-a010-75ff0827cc87" released by "delete_volume" :: held 1.168s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:49 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 Jul 21 17:23:49 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:49 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Created reservations ['3ad21412-57aa-4721-9728-af85342fba1e', 'd6a8b7d9-bace-4051-a003-66899877fe54', '99bc8591-53b2-488a-9443-7897a670a331', '5917e5fb-f003-486b-b0d2-7c6785e89b4d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:50 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:50 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:50 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600" returned: 0 in 1.183s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:50 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600 Jul 21 17:23:50 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:50 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.768s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:51 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Deleted volume successfully. Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ed416284-840c-4fa2-83c1-9f37b0fbc8b3 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-376cc86f-bc3c-4b12-a010-75ff0827cc87-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:51 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a7a997ea-1959-4910-8f2a-b81cc2e8e600" returned: 0 in 0.565s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-a7a997ea-1959-4910-8f2a-b81cc2e8e600" released by "delete_volume" :: held 1.851s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Created reservations ['523fcf4d-24b2-47e9-9304-6e8a44ea6416', '4b58137d-76b7-4238-bd9e-9d85f63b9eba', '6c0c61ed-641f-4271-9c77-8021aefb4c6c', '6fd1f1ec-9747-43d8-aa6f-7738bf9ff392'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:51 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:51 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-84beb7d1-8a0a-493f-8328-adb58f381edb-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Lock "cinder-84beb7d1-8a0a-493f-8328-adb58f381edb-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-84beb7d1-8a0a-493f-8328-adb58f381edb" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:23:52 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.655s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-84beb7d1-8a0a-493f-8328-adb58f381edb" acquired by "delete_volume" :: waited 0.064s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:23:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae50932c-708e-4b6a-a169-173afd7434fa]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3630e42b-034b-4a8b-a71b-4536e9739aa7 tempest-VolumesGetTest-1021308160 None] Lock "cinder-a7a997ea-1959-4910-8f2a-b81cc2e8e600-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (e14dc18c-db79-4052-ad0b-e15795e3a819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2ea8d-fa69-44b8-82cc-cc6463c1a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2ea8d-fa69-44b8-82cc-cc6463c1a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587702286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:53Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:52 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:52 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb65c0-7784-48ae-b43c-5752dcf54bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb65c0-7784-48ae-b43c-5752dcf54bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f82299-0736-4d58-a841-43ba28f05288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f82299-0736-4d58-a841-43ba28f05288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae', 'volume_name': 'volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa67beb5-067c-4718-a20d-757725cd3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa67beb5-067c-4718-a20d-757725cd3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9552005-d4fd-46be-9d0e-6e43fdb31c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Volume 5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae', 'volume_size': 1} Jul 21 17:23:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:53 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 1.157s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:53 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb Jul 21 17:23:53 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:54 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-84beb7d1-8a0a-493f-8328-adb58f381edb" returned: 0 in 0.627s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-84beb7d1-8a0a-493f-8328-adb58f381edb" released by "delete_volume" :: held 2.000s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Created reservations ['f87521a0-5b52-4576-a93d-b2f4bec8d9ec', '2c34200e-26f8-44cb-a8d0-fde74ee6a9ff', '67374a8a-fd54-4b9a-b333-7d322d443fd0', 'acff5014-29d2-4818-8520-504c625d1e26'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:54 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:23:54 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:55 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img" returned: 0 in 6.102s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[178fb409-4a94-466c-abd9-988919a8b73f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:55 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:23:55 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:55 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:23:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9f0487a6-0fa7-4328-a4a5-4df21620e52c tempest-VolumesGetTest-1021308160 None] Lock "cinder-84beb7d1-8a0a-493f-8328-adb58f381edb-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:23:55 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.589s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:23:55 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Converted 1024.00 MB image at 167.78 MB/s Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] b5d2adfc-9669-4520-b91c-fa8ebd7a83df was raw, converting to qcow2 {{(pid=87591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2dc2f-a9d8-40c6-bc1e-000b3b0c6c8e]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:55 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img Jul 21 17:23:55 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:56 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img" returned: 0 in 0.342s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:56 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img Jul 21 17:23:56 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:56 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img" returned: 1 in 0.334s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img /opt/stack/data/cinder/conversion/vol_upload_cstld49w {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:56 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img /opt/stack/data/cinder/conversion/vol_upload_cstld49w Jul 21 17:23:56 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (7fe309ee-9b40-46f4-bb63-6ba7f86fe792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b759db-9d3b-457b-8770-13863e0029b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b759db-9d3b-457b-8770-13863e0029b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1233736704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1243e8cd-4219-45fc-9aaa-be85b3e61b29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:56Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1094a3bd-4ea9-4539-8b29-0a33951da913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1094a3bd-4ea9-4539-8b29-0a33951da913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e1fc7e-2bab-4882-9681-f75dab2e50ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:23:56 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img /opt/stack/data/cinder/conversion/vol_upload_cstld49w" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Image conversion details: src /opt/stack/data/cinder/conversion/73b1a77a-1aea-44b0-a298-34d687376299.temp_image.b5d2adfc-9669-4520-b91c-fa8ebd7a83dftcgi2upf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cstld49w {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:23:56 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9403116f-eb35-4ccf-afde-52f37a9656bd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cstld49w {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:56 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cstld49w Jul 21 17:23:56 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e1fc7e-2bab-4882-9681-f75dab2e50ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1243e8cd-4219-45fc-9aaa-be85b3e61b29', 'volume_name': 'volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a6776d-7321-4f53-a0f6-0e93547f3cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a6776d-7321-4f53-a0f6-0e93547f3cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd366a6b-92a9-4a93-9b70-0d58f9985f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:56 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Volume 1243e8cd-4219-45fc-9aaa-be85b3e61b29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 17:23:56 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Trying to clone 1243e8cd-4219-45fc-9aaa-be85b3e61b29 from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:23:57 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cstld49w" returned: 0 in 0.346s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:23:57 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Image download 20.69 MB at 20.69 MB/s Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1ec225-a603-42d4-8801-b1534de60755]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:57 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD Jul 21 17:23:57 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:57 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 is fetched for user 676fb0949e70440392674b167e348dd8. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f91c5-3097-402c-b9ca-c89424e2496f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:23:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:58 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD Jul 21 17:23:58 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:58 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.881s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Uploaded volume to glance image-id: b5d2adfc-9669-4520-b91c-fa8ebd7a83df. {{(pid=87591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.839s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587702286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:53Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Creating volume 5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:23:58 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:23:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:58 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae 1073741824 Jul 21 17:23:58 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d9f9f8b0-186a-498a-9f82-c1499d4eb802 tempest-VolumesActionsTest-883004062 None] Copy volume to image completed successfully. Jul 21 17:23:59 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae 1073741824" returned: 0 in 0.559s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:59 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae Jul 21 17:23:59 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:59 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1233736704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1243e8cd-4219-45fc-9aaa-be85b3e61b29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:23:56Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Creating volume 1243e8cd-4219-45fc-9aaa-be85b3e61b29 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:23:59 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9552005-d4fd-46be-9d0e-6e43fdb31c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:59 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 1073741824 Jul 21 17:23:59 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9a5fb6-9427-4833-875e-15484d08494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:23:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Volume volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae (5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae): created successfully Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9a5fb6-9427-4833-875e-15484d08494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:23:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (e14dc18c-db79-4052-ad0b-e15795e3a819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:23:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-768b8209-3a85-420d-9b7b-0ad6aa76394b tempest-VolumesActionsTest-852452289 None] Created volume successfully. Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Acquiring lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Acquiring lock "cinder-quobyte-73b1a77a-1aea-44b0-a298-34d687376299" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-quobyte-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Lock "cinder-quobyte-73b1a77a-1aea-44b0-a298-34d687376299" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af66f2-2079-4623-9de0-0deb477df808]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:00 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32e549-9bf1-4239-a6c6-27795bcff574]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 1073741824" returned: 0 in 0.732s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:00 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 Jul 21 17:24:00 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:00 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae Jul 21 17:24:00 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:24:00 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:00 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:00 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:00 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:00 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29" returned: 0 in 0.359s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.465s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:01 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae Jul 21 17:24:01 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:01 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299 Jul 21 17:24:01 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Attempting download of 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 1243e8cd-4219-45fc-9aaa-be85b3e61b29. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69846e2-9a13-489d-9bff-3d8ba38fea57]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:01 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk Jul 21 17:24:01 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:01 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae" released by "delete_volume" :: held 0.772s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:01 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-73b1a77a-1aea-44b0-a298-34d687376299" returned: 0 in 0.342s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Created reservations ['21dd1476-5a94-4ed3-b8cb-b4134f6821b3', '7d7af625-ef6f-488c-9a09-a87c517a579c', 'f4c2417d-b968-43ea-8eb6-0fb6d8b64682', '9589a759-1a61-4813-911a-1f2d60b24380'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Lock "cinder-quobyte-73b1a77a-1aea-44b0-a298-34d687376299" released by "delete_volume" :: held 0.870s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:01 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk" returned: 0 in 0.387s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Created reservations ['d39954f6-a84a-47df-b4e1-e1224df830c1', '91f9e760-744c-4614-a446-0bd39cedf701', 'f7329b1d-88dd-4816-ab34-65b37cbd125a', '6f63fa25-90d5-4159-9a50-2eac95e2e012'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:01 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:01 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:01 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk Jul 21 17:24:01 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:01 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:01 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:01 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.461s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Deleted volume successfully. Jul 21 17:24:01 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk" returned: 1 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_fivryudk' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a28e9a3-5e30-4ce4-bca3-4e61a5fe9787]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0e0b1fca-ecd8-4afc-a76d-995fbc64e756 tempest-VolumesActionsTest-1145425151 None] Lock "cinder-5cc17d2c-d6ad-47aa-80a1-3978b02ae5ae-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:02 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD Jul 21 17:24:02 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:02 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.546s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Deleted volume successfully. Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97a25d1d-d23e-449c-ab51-25264f452d4e tempest-VolumesActionsTest-883004062 None] Lock "cinder-73b1a77a-1aea-44b0-a298-34d687376299-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:02 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (8165d952-091e-4752-a9f5-0fbe30a27cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284fa142-c72b-433d-8ce6-1bb5833f0904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] 2aa331ac-4aaf-451f-bbe4-0351cabe0710 was qcow2, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284fa142-c72b-433d-8ce6-1bb5833f0904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-951355236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680a2228-00be-459b-bca1-88759ccd8c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:02Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb4553a-1456-4f4d-938f-7edf300e2cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb4553a-1456-4f4d-938f-7edf300e2cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:02 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 Jul 21 17:24:02 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95870133-3c07-4416-b50b-27108875781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95870133-3c07-4416-b50b-27108875781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680a2228-00be-459b-bca1-88759ccd8c22', 'volume_name': 'volume-680a2228-00be-459b-bca1-88759ccd8c22', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382ab19c-492b-4693-982b-5c50339b9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382ab19c-492b-4693-982b-5c50339b9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bc8238-4f10-4072-9331-43fcca670a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:02 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Volume 680a2228-00be-459b-bca1-88759ccd8c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680a2228-00be-459b-bca1-88759ccd8c22', 'volume_size': 1} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-951355236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680a2228-00be-459b-bca1-88759ccd8c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:02Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Creating volume 680a2228-00be-459b-bca1-88759ccd8c22 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:02 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:02 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 1073741824 Jul 21 17:24:02 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:03 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 1073741824" returned: 0 in 0.640s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:03 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 Jul 21 17:24:03 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:03 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22" returned: 0 in 0.443s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bc8238-4f10-4072-9331-43fcca670a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680a2228-00be-459b-bca1-88759ccd8c22', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adb2e92-15e5-4fef-83e6-fcde835ea662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Volume volume-680a2228-00be-459b-bca1-88759ccd8c22 (680a2228-00be-459b-bca1-88759ccd8c22): created successfully Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adb2e92-15e5-4fef-83e6-fcde835ea662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (8165d952-091e-4752-a9f5-0fbe30a27cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-370574ad-f9d9-4161-9a20-22d7b6cd7a43 tempest-VolumesActionsTest-852452289 None] Created volume successfully. Jul 21 17:24:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-680a2228-00be-459b-bca1-88759ccd8c22-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Lock "cinder-680a2228-00be-459b-bca1-88759ccd8c22-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Acquiring lock "cinder-quobyte-680a2228-00be-459b-bca1-88759ccd8c22" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-680a2228-00be-459b-bca1-88759ccd8c22" acquired by "delete_volume" :: waited 0.031s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:04 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889b70d-2a83-453c-9d28-0d26aff93777]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:05 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29" returned: 0 in 2.561s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_a5x7h8bsdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:24:05 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Converted 112.00 MB image at 43.71 MB/s Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:05 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 Jul 21 17:24:05 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:05 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 1G Jul 21 17:24:05 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:05 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22" returned: 0 in 0.476s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:05 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22 Jul 21 17:24:05 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:05 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 1G" returned: 0 in 0.404s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Downloaded image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 1243e8cd-4219-45fc-9aaa-be85b3e61b29 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 for user 676fb0949e70440392674b167e348dd8 is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Marking volume 1243e8cd-4219-45fc-9aaa-be85b3e61b29 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Copying metadata from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 to 1243e8cd-4219-45fc-9aaa-be85b3e61b29. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Creating volume glance metadata for volume 1243e8cd-4219-45fc-9aaa-be85b3e61b29 backed by image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd366a6b-92a9-4a93-9b70-0d58f9985f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146ced72-25c5-4931-858b-9c83f1a58379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Volume volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 (1243e8cd-4219-45fc-9aaa-be85b3e61b29): created successfully Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146ced72-25c5-4931-858b-9c83f1a58379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (7fe309ee-9b40-46f4-bb63-6ba7f86fe792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:05 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2e78cb67-fe72-4820-9035-50f54d3dbf41 tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:24:05 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-680a2228-00be-459b-bca1-88759ccd8c22" returned: 0 in 0.322s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Lock "cinder-quobyte-680a2228-00be-459b-bca1-88759ccd8c22" released by "delete_volume" :: held 0.862s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Created reservations ['8a56ce92-eb9b-4b63-a98d-7b5d3089c40a', 'dbfa94e7-6340-401d-bcf1-9343d98ffa6a', 'ab15556e-a2be-4185-bfdc-dc0232db65fa', '4cfbed76-152f-473b-a543-8902d2c54d5a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:05 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:05 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:06 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Deleted volume successfully. Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-100e2760-c2b6-4cd6-b47b-414254d6784a tempest-VolumesActionsTest-1145425151 None] Lock "cinder-680a2228-00be-459b-bca1-88759ccd8c22-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (fa5317fe-e98a-4d1e-9327-30f9e08720d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8223d6-cc84-42ef-a6f5-4b07ad43e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8223d6-cc84-42ef-a6f5-4b07ad43e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1759870766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b0e3e4-8295-46a7-912e-0e7562c3b8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:07Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eb0e7f-ce69-4944-a64d-c221337d0b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eb0e7f-ce69-4944-a64d-c221337d0b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d503a95e-ef8d-45a8-9c65-2f712ba9502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d503a95e-ef8d-45a8-9c65-2f712ba9502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b0e3e4-8295-46a7-912e-0e7562c3b8b0', 'volume_name': 'volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d54f94b-d590-44b1-b68a-3a0741370d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d54f94b-d590-44b1-b68a-3a0741370d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936b1e35-659b-49a5-843b-1ee0d73044cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:06 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Volume a2b0e3e4-8295-46a7-912e-0e7562c3b8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0', 'volume_size': 1} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1759870766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b0e3e4-8295-46a7-912e-0e7562c3b8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74220356034f4f07a171aa272c405fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:07Z,use_quota=True,user_id='e32541d45d5d4e13b8e786639be1be83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Creating volume a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:06 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:06 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 1073741824 Jul 21 17:24:06 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (51697bdc-d848-4ac7-bb1e-bbc0514f3d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83578e1b-70bf-417c-b71e-33fc20a94f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83578e1b-70bf-417c-b71e-33fc20a94f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-472469530',display_name='tempest-VolumesGetTest-Volume-558832145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b49a90-9ab0-4cea-a48d-27af2ca3b8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:07Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5caf80-6f3d-4bec-a49a-2f2320ae4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5caf80-6f3d-4bec-a49a-2f2320ae4001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09639afd-c296-4bfb-95f5-5f76d4f502a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09639afd-c296-4bfb-95f5-5f76d4f502a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b49a90-9ab0-4cea-a48d-27af2ca3b8b8', 'volume_name': 'volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86ea4c-5094-4bdf-ab04-990082a0f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86ea4c-5094-4bdf-ab04-990082a0f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8caf611-f244-4f19-bcdd-73eb97e0eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:07 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Volume 48b49a90-9ab0-4cea-a48d-27af2ca3b8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8', 'volume_size': 1} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:07 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 1073741824" returned: 0 in 0.559s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:07 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 Jul 21 17:24:07 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:07 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0" returned: 0 in 0.267s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-472469530',display_name='tempest-VolumesGetTest-Volume-558832145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b49a90-9ab0-4cea-a48d-27af2ca3b8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89407cf38ce847a6a82343abd3e26d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:07Z,use_quota=True,user_id='676fb0949e70440392674b167e348dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Creating volume 48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:07 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936b1e35-659b-49a5-843b-1ee0d73044cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b9d53a-1828-4a48-93d9-f56a253ae5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:07 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 1073741824 Jul 21 17:24:07 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:07 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Volume volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 (a2b0e3e4-8295-46a7-912e-0e7562c3b8b0): created successfully Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b9d53a-1828-4a48-93d9-f56a253ae5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Flow 'volume_create_manager' (fa5317fe-e98a-4d1e-9327-30f9e08720d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:07 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-715fbc59-8dc6-4d27-9a34-d234e9716d97 tempest-VolumesActionsTest-852452289 None] Created volume successfully. Jul 21 17:24:08 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 1073741824" returned: 0 in 0.569s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:08 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 Jul 21 17:24:08 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:08 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8" returned: 0 in 0.290s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8caf611-f244-4f19-bcdd-73eb97e0eac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed5a44d-602e-467c-ba06-d4e275df44bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:08 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Volume volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 (48b49a90-9ab0-4cea-a48d-27af2ca3b8b8): created successfully Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed5a44d-602e-467c-ba06-d4e275df44bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Flow 'volume_create_manager' (51697bdc-d848-4ac7-bb1e-bbc0514f3d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-66d3e3c7-a400-4632-bf06-376837f8ba6c tempest-VolumesGetTest-1021308160 None] Created volume successfully. Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Lock "cinder-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd607b2-f283-4b09-a1b2-133b19715dbf]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Acquiring lock "cinder-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Lock "cinder-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Acquiring lock "cinder-quobyte-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Lock "cinder-quobyte-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:09 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 Jul 21 17:24:09 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb1c361-903f-4ecb-859f-2dc3eed2d15c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:09 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 Jul 21 17:24:09 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:10 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8" returned: 0 in 0.446s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:10 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8 Jul 21 17:24:10 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:10 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0" returned: 0 in 0.446s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:10 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0 Jul 21 17:24:10 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:10 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8" returned: 0 in 0.296s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8" released by "delete_volume" :: held 0.812s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Created reservations ['5001c728-6971-4af9-8e61-e3e6200b5b74', 'e6bd89a5-e170-41f3-ab77-44bbc47c3cd7', '52e17597-73c0-44e8-9f6d-e9b0e082c5b1', '9449bdb0-ca94-4c71-a3a0-4baaa97bb06e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:10 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:10 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:10 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Lock "cinder-quobyte-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0" released by "delete_volume" :: held 0.847s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Created reservations ['da47ebbc-5917-4f2f-977e-b1a17868bdd5', 'a8951711-31b0-4aea-a6a0-c281f59f5bc1', '467e42f6-bfd5-48fc-b889-24ad0adb5ff8', 'cbea246e-a83c-4d49-909d-6b64d92cc540'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-1243e8cd-4219-45fc-9aaa-be85b3e61b29-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:10 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:24:10 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Lock "cinder-1243e8cd-4219-45fc-9aaa-be85b3e61b29-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:10 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cde6571f-371c-46b9-9eb3-81a0afe9583d tempest-VolumesGetTest-1021308160 None] Lock "cinder-48b49a90-9ab0-4cea-a48d-27af2ca3b8b8-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Acquiring lock "cinder-quobyte-1243e8cd-4219-45fc-9aaa-be85b3e61b29" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-1243e8cd-4219-45fc-9aaa-be85b3e61b29" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[08564c33-c123-4253-81cd-5fe544662990]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:11 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 Jul 21 17:24:11 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:11 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Deleted volume successfully. Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-40eecbcb-7008-4e81-a0b7-fb313d580fa4 tempest-VolumesActionsTest-852452289 None] Lock "cinder-a2b0e3e4-8295-46a7-912e-0e7562c3b8b0-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:11 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:11 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29 Jul 21 17:24:11 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Flow 'volume_create_manager' (e812071b-eaf3-414e-bda1-4f53b096d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1cc72a-fc8b-465a-997f-20af77360b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1cc72a-fc8b-465a-997f-20af77360b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1441760617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d2337d-c17c-44e3-9f92-0d87bc17b997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa225bce2abe4527b3491467e56ffc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:12Z,use_quota=True,user_id='9f23da21eda0479ab20553c56935b3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281eaa5d-d321-4925-8ddf-80af2e697747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281eaa5d-d321-4925-8ddf-80af2e697747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3758dfaa-c8c6-4062-9247-f8b66f332660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3758dfaa-c8c6-4062-9247-f8b66f332660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d2337d-c17c-44e3-9f92-0d87bc17b997', 'volume_name': 'volume-75d2337d-c17c-44e3-9f92-0d87bc17b997', 'volume_size': 2}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdea961-a3e6-49cb-ad45-697280b41ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdea961-a3e6-49cb-ad45-697280b41ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7bf762-8e0e-491a-9e83-c77dbf9dd489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:11 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Volume 75d2337d-c17c-44e3-9f92-0d87bc17b997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d2337d-c17c-44e3-9f92-0d87bc17b997', 'volume_size': 2} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1441760617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d2337d-c17c-44e3-9f92-0d87bc17b997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa225bce2abe4527b3491467e56ffc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:12Z,use_quota=True,user_id='9f23da21eda0479ab20553c56935b3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Creating volume 75d2337d-c17c-44e3-9f92-0d87bc17b997 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:11 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 2147483648 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:11 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 2147483648 Jul 21 17:24:11 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:11 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1243e8cd-4219-45fc-9aaa-be85b3e61b29" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Lock "cinder-quobyte-1243e8cd-4219-45fc-9aaa-be85b3e61b29" released by "delete_volume" :: held 0.836s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:11 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Created reservations ['75882063-f899-4b08-bb97-146055dae106', '281ac26b-9bb2-47ee-bc1d-ffcdd3229579', 'd18e72f5-cb1a-4e85-9d0a-a497a7274a5a', '9c0d8738-a414-4b1c-b38c-9ec8dcd76f43'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:12 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:12 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:12 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.311s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Deleted volume successfully. Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0de290b3-f75c-445a-89dc-0ed50af7c6c2 tempest-VolumesGetTest-1021308160 None] Lock "cinder-1243e8cd-4219-45fc-9aaa-be85b3e61b29-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:12 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 2147483648" returned: 0 in 0.710s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:12 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 Jul 21 17:24:12 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:12 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997" returned: 0 in 0.322s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7bf762-8e0e-491a-9e83-c77dbf9dd489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d2337d-c17c-44e3-9f92-0d87bc17b997', 'volume_size': 2}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14839cd-1cd4-48fc-bd91-b60ec740bd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Volume volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 (75d2337d-c17c-44e3-9f92-0d87bc17b997): created successfully Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14839cd-1cd4-48fc-bd91-b60ec740bd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Flow 'volume_create_manager' (e812071b-eaf3-414e-bda1-4f53b096d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ece1ec0e-2aa1-43d6-ba07-941f68b47d29 tempest-VolumesCloneNegativeTest-1089178509 None] Created volume successfully. Jul 21 17:24:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Acquiring lock "cinder-75d2337d-c17c-44e3-9f92-0d87bc17b997-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "cinder-75d2337d-c17c-44e3-9f92-0d87bc17b997-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Acquiring lock "cinder-quobyte-75d2337d-c17c-44e3-9f92-0d87bc17b997" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "cinder-quobyte-75d2337d-c17c-44e3-9f92-0d87bc17b997" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf977063-6fbb-4aed-b491-96fb14a41720]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:14 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 Jul 21 17:24:14 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:14 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997" returned: 0 in 0.424s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:14 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997 Jul 21 17:24:14 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:14 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-75d2337d-c17c-44e3-9f92-0d87bc17b997" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "cinder-quobyte-75d2337d-c17c-44e3-9f92-0d87bc17b997" released by "delete_volume" :: held 0.775s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Created reservations ['a6c530a5-743c-447b-a489-21b01354920a', 'ebeb3d16-627c-4d8b-bfcf-a90e89ea157a', 'e524d395-21a4-45c6-ac70-63c5832c2b69', '950402c3-7d06-4cb1-8feb-a7c1dc4bdde5'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:14 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:14 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:15 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:15 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Deleted volume successfully. Jul 21 17:24:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2227f518-8d38-4c3b-ab82-94fc06a376c7 tempest-VolumesCloneNegativeTest-1089178509 None] Lock "cinder-75d2337d-c17c-44e3-9f92-0d87bc17b997-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:19 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Flow 'volume_create_manager' (39a98be7-1029-42bc-91b1-2b3706a1af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f3553f-6994-449f-9a49-3f1da644cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f3553f-6994-449f-9a49-3f1da644cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-782324079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a780e4b-c352-429f-aac1-10391cc6d93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec0ec8ad874a1eb67cca99cc251348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:20Z,use_quota=True,user_id='91463a4f3aec4270a82221568a0e7d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50448743-bdb4-445a-9747-20e0ddf840bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50448743-bdb4-445a-9747-20e0ddf840bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a01cf03-9108-4099-ae7b-98929975bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a01cf03-9108-4099-ae7b-98929975bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a780e4b-c352-429f-aac1-10391cc6d93b', 'volume_name': 'volume-9a780e4b-c352-429f-aac1-10391cc6d93b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3745701-71e1-43bb-8f86-fee90d44194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3745701-71e1-43bb-8f86-fee90d44194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a47f151-14a7-4b9b-b79f-ec91a11004d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Volume 9a780e4b-c352-429f-aac1-10391cc6d93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a780e4b-c352-429f-aac1-10391cc6d93b', 'volume_size': 1} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-782324079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a780e4b-c352-429f-aac1-10391cc6d93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec0ec8ad874a1eb67cca99cc251348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:20Z,use_quota=True,user_id='91463a4f3aec4270a82221568a0e7d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Creating volume 9a780e4b-c352-429f-aac1-10391cc6d93b {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:20 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:20 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b 1073741824 Jul 21 17:24:20 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Flow 'volume_create_manager' (55ee7592-a110-4315-92d6-7d05e9d871f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ef203c-dfdf-45e1-9942-c15af2d7c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ef203c-dfdf-45e1-9942-c15af2d7c84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1973467190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af55faeaca484119aa644462702ef187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:20Z,use_quota=True,user_id='0f0191e374b64387a82853af4b658642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f5bd5c-3983-417d-b0b1-93b0267d7d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f5bd5c-3983-417d-b0b1-93b0267d7d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d47c74-6229-463d-82aa-57e97e915b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:24:20 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b 1073741824" returned: 0 in 0.642s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:20 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b Jul 21 17:24:20 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d47c74-6229-463d-82aa-57e97e915b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58', 'volume_name': 'volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f066d0f-df93-46dd-b283-8bb61e5fa543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f066d0f-df93-46dd-b283-8bb61e5fa543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4589d462-86b1-4895-8ae7-4748a1a5164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Volume 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 17:24:20 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Trying to clone 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:24:21 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a47f151-14a7-4b9b-b79f-ec91a11004d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a780e4b-c352-429f-aac1-10391cc6d93b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5faf0f3-835c-4141-86a3-590619348c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:21 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Volume volume-9a780e4b-c352-429f-aac1-10391cc6d93b (9a780e4b-c352-429f-aac1-10391cc6d93b): created successfully Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5faf0f3-835c-4141-86a3-590619348c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Flow 'volume_create_manager' (39a98be7-1029-42bc-91b1-2b3706a1af3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-46328504-42c3-4e61-bcb9-207bfaf57a1c tempest-VolumesNegativeTest-1001100492 None] Created volume successfully. Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:24:21 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Image download 20.69 MB at 20.69 MB/s Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675a82c-06aa-4267-b471-301d31f8a607]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:21 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD Jul 21 17:24:21 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Flow 'volume_create_manager' (da84824b-ba5f-407c-9b96-01d4017ed684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d1a607-d405-4a13-9bf8-ed92bcfa8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d1a607-d405-4a13-9bf8-ed92bcfa8cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-749521683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c6ea17-b837-4583-beb2-8a4d06444dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93202c300aff43dc967e27fefb1ffd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:22Z,use_quota=True,user_id='356e1569230343ab84914525833d4c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246d36d6-37da-4410-8d29-1d0ed8f9051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246d36d6-37da-4410-8d29-1d0ed8f9051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9a0934-c4ed-4d8d-a7c9-4a9343252795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:24:21 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:21 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 is fetched for user 0f0191e374b64387a82853af4b658642. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[275c44a3-f9fc-4ef4-b176-1a2694963909]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9a0934-c4ed-4d8d-a7c9-4a9343252795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19c6ea17-b837-4583-beb2-8a4d06444dc9', 'volume_name': 'volume-19c6ea17-b837-4583-beb2-8a4d06444dc9', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ab8112-d749-4756-ad2f-41c341aa9a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ab8112-d749-4756-ad2f-41c341aa9a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0724e181-3b96-4243-b4c0-fc91e5e695b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:22 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Volume 19c6ea17-b837-4583-beb2-8a4d06444dc9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19c6ea17-b837-4583-beb2-8a4d06444dc9', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Trying to clone 19c6ea17-b837-4583-beb2-8a4d06444dc9 from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:24:22 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD Jul 21 17:24:22 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:22 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1973467190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af55faeaca484119aa644462702ef187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:20Z,use_quota=True,user_id='0f0191e374b64387a82853af4b658642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Creating volume 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:22 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:22 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 1073741824 Jul 21 17:24:22 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:24:22 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Image download 20.69 MB at 20.69 MB/s Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84260de-58e9-4722-9ae9-ae84e4dca6ff]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:22 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD Jul 21 17:24:22 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:23 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 1073741824" returned: 0 in 0.646s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:23 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 is fetched for user 356e1569230343ab84914525833d4c98. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:23 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 Jul 21 17:24:23 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef896b4-e361-408e-87ef-2c3f4297dd7f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:23 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD Jul 21 17:24:23 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:23 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Attempting download of 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8757d43b-eada-4fde-91d6-a06d88d3eeea]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:23 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-749521683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c6ea17-b837-4583-beb2-8a4d06444dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93202c300aff43dc967e27fefb1ffd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:22Z,use_quota=True,user_id='356e1569230343ab84914525833d4c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Creating volume 19c6ea17-b837-4583-beb2-8a4d06444dc9 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:23 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:23 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 1073741824 Jul 21 17:24:23 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:23 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1 Jul 21 17:24:23 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:24 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1" returned: 0 in 0.439s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:24 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1 Jul 21 17:24:24 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:24 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 1073741824" returned: 0 in 0.620s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:24 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1" returned: 1 in 0.426s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710_xrzfoft1' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec043b0f-fa36-46dc-a901-46254fb7c102]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:24 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 Jul 21 17:24:24 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:24 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD Jul 21 17:24:24 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:24 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9" returned: 0 in 0.454s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:25 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] 2aa331ac-4aaf-451f-bbe4-0351cabe0710 was qcow2, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Attempting download of 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 19c6ea17-b837-4583-beb2-8a4d06444dc9. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:24:25 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 Jul 21 17:24:25 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f076543-4154-4dc8-9c79-2d081ae31849]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:25 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve Jul 21 17:24:25 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:25 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve" returned: 0 in 0.541s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:25 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve Jul 21 17:24:25 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:26 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve" returned: 1 in 0.394s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aa331ac-4aaf-451f-bbe4-0351cabe0710__ul56eve' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6a788-7b5e-4926-a7fc-2be4006df535]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:26 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD Jul 21 17:24:26 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:26 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] 2aa331ac-4aaf-451f-bbe4-0351cabe0710 was qcow2, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:24:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:26 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 Jul 21 17:24:26 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:27 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" returned: 0 in 2.515s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:27 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_vx94_czydevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:24:27 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Converted 112.00 MB image at 44.50 MB/s Jul 21 17:24:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:27 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 1G Jul 21 17:24:27 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:28 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 1G" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Downloaded image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 for user 0f0191e374b64387a82853af4b658642 is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Marking volume 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Copying metadata from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 to 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Creating volume glance metadata for volume 8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 backed by image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4589d462-86b1-4895-8ae7-4748a1a5164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297a5769-44c7-4c76-b78f-db1cb8d3093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Volume volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 (8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58): created successfully Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297a5769-44c7-4c76-b78f-db1cb8d3093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Flow 'volume_create_manager' (55ee7592-a110-4315-92d6-7d05e9d871f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-580981f7-7295-4451-8777-9295f84b7a41 tempest-VolumesExtendTest-847204164 None] Created volume successfully. Jul 21 17:24:29 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9" returned: 0 in 2.643s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2aa331ac-4aaf-451f-bbe4-0351cabe0710_jfmwmnbbdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:24:29 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Converted 112.00 MB image at 42.35 MB/s Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:29 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 1G Jul 21 17:24:29 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc5db6-4c07-4387-9dd7-f02090212c0c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:29 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 Jul 21 17:24:29 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:30 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 1G" returned: 0 in 0.885s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Downloaded image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}])) to volume 19c6ea17-b837-4583-beb2-8a4d06444dc9 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Temporary image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 for user 356e1569230343ab84914525833d4c98 is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Marking volume 19c6ea17-b837-4583-beb2-8a4d06444dc9 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Copying metadata from image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 to 19c6ea17-b837-4583-beb2-8a4d06444dc9. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Creating volume glance metadata for volume 19c6ea17-b837-4583-beb2-8a4d06444dc9 backed by image 2aa331ac-4aaf-451f-bbe4-0351cabe0710 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0724e181-3b96-4243-b4c0-fc91e5e695b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c6ea17-b837-4583-beb2-8a4d06444dc9', 'volume_size': 1, 'image_id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0351f847948443fcaaeec8246982d5d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2aa331ac-4aaf-451f-bbe4-0351cabe0710', 'created_at': datetime.datetime(2026, 7, 21, 15, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aa331ac-4aaf-451f-bbe4-0351cabe0710/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e209a4-5e5b-4566-8503-82d7e6838cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Volume volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 (19c6ea17-b837-4583-beb2-8a4d06444dc9): created successfully Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e209a4-5e5b-4566-8503-82d7e6838cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Flow 'volume_create_manager' (da84824b-ba5f-407c-9b96-01d4017ed684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:30 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" returned: 0 in 0.691s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 2G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e828e57f-89d8-4e6a-8106-64626973fcba tempest-TestShelveInstance-810845451 None] Created volume successfully. Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 2G" returned: 0 in 0.137s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.874s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-86fa94ce-2477-4f03-9c17-836fcd8e0f41 tempest-VolumesExtendTest-847204164 None] Extend volume completed successfully. Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Flow 'volume_create_manager' (91294acb-6b71-4e79-9ed4-37faec8395d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a1e85a-9825-4d5f-b2bd-5a9d184cd289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a1e85a-9825-4d5f-b2bd-5a9d184cd289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1290265871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8936be5-e0c2-4b65-8533-195ed6e319c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a172ca0d30b43f082835f7c9b64f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:31Z,use_quota=True,user_id='b6471626e635428cbed0cbfd1e4a270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aae39a-227c-4a19-8c1b-faeae826a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aae39a-227c-4a19-8c1b-faeae826a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb156b81-5677-447b-95a6-2cda56ac0e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb156b81-5677-447b-95a6-2cda56ac0e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8936be5-e0c2-4b65-8533-195ed6e319c8', 'volume_name': 'volume-f8936be5-e0c2-4b65-8533-195ed6e319c8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c449e3-b8f9-485a-ad6a-9f523b048920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c449e3-b8f9-485a-ad6a-9f523b048920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b160810-d2e5-4088-a33c-f46815536f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:31 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Volume f8936be5-e0c2-4b65-8533-195ed6e319c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8936be5-e0c2-4b65-8533-195ed6e319c8', 'volume_size': 1} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1290265871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8936be5-e0c2-4b65-8533-195ed6e319c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a172ca0d30b43f082835f7c9b64f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:31Z,use_quota=True,user_id='b6471626e635428cbed0cbfd1e4a270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Creating volume f8936be5-e0c2-4b65-8533-195ed6e319c8 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:31 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:31 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 1073741824 Jul 21 17:24:31 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Lock "cinder-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-quobyte-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" acquired by "delete_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc5a688-fdc8-4f68-86d3-73c40980fda2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:31 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 Jul 21 17:24:31 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:31 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 1073741824" returned: 0 in 0.817s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:32 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 Jul 21 17:24:32 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:32 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" returned: 0 in 0.703s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:32 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58 Jul 21 17:24:32 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:32 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8" returned: 0 in 0.439s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b160810-d2e5-4088-a33c-f46815536f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8936be5-e0c2-4b65-8533-195ed6e319c8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7f5551-5203-49fe-837a-a3f4c22d5b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:32 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Volume volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 (f8936be5-e0c2-4b65-8533-195ed6e319c8): created successfully Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7f5551-5203-49fe-837a-a3f4c22d5b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Flow 'volume_create_manager' (91294acb-6b71-4e79-9ed4-37faec8395d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-835fd61b-cc26-47fb-916e-60035f81522a tempest-VolumesListAdminTestJSON-286702982 None] Created volume successfully. Jul 21 17:24:32 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" returned: 0 in 0.457s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58" released by "delete_volume" :: held 1.235s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Created reservations ['fc3088a0-42ee-4acd-a44f-fd833aac6be2', 'e9436d96-ca30-4008-844c-2066c4963b40', '1acf05cf-5669-411d-94b5-af6dcd82b6b1', '6acee469-b65a-4d7f-8b60-d9c504ddeee8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:32 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:32 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:33 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.333s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:33 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Deleted volume successfully. Jul 21 17:24:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3a905f5e-2f62-4df2-919a-fed2145a988c tempest-VolumesExtendTest-847204164 None] Lock "cinder-8a9f0db6-9f9e-47c1-ae9d-303cb7d83e58-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Flow 'volume_create_manager' (2ab8a32a-0d43-47f5-8f0d-596b7c338eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6180b197-c93d-4be8-a5a5-090c22a14398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6180b197-c93d-4be8-a5a5-090c22a14398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-825733507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3b0387-d5ae-4ca6-a46c-1660677060cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a172ca0d30b43f082835f7c9b64f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:34Z,use_quota=True,user_id='b6471626e635428cbed0cbfd1e4a270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa4946d-f663-4bbe-9051-fefa9fe65f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa4946d-f663-4bbe-9051-fefa9fe65f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8d9aa8-e22d-4b22-a815-760e1ebeaa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8d9aa8-e22d-4b22-a815-760e1ebeaa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3b0387-d5ae-4ca6-a46c-1660677060cd', 'volume_name': 'volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081068f5-4e21-412e-8234-3bdec3a26784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081068f5-4e21-412e-8234-3bdec3a26784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf62b789-5b21-4fcb-a622-26a99977b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Volume ee3b0387-d5ae-4ca6-a46c-1660677060cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd', 'volume_size': 1} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-825733507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3b0387-d5ae-4ca6-a46c-1660677060cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a172ca0d30b43f082835f7c9b64f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:34Z,use_quota=True,user_id='b6471626e635428cbed0cbfd1e4a270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Creating volume ee3b0387-d5ae-4ca6-a46c-1660677060cd {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:34 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:34 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd 1073741824 Jul 21 17:24:34 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Flow 'volume_create_manager' (e8367696-0c15-4995-8f2f-cb720a7b9228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91f24db-2b9b-4974-96b0-b461c3f9d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91f24db-2b9b-4974-96b0-b461c3f9d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-786155922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9911ef7d-686f-4155-b6b4-8ff804eaecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af55faeaca484119aa644462702ef187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:34Z,use_quota=True,user_id='0f0191e374b64387a82853af4b658642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cba1d6-1eeb-464b-9e9d-77e71a62b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cba1d6-1eeb-464b-9e9d-77e71a62b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b74e881-8c62-4878-8f50-3b5b99235a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b74e881-8c62-4878-8f50-3b5b99235a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9911ef7d-686f-4155-b6b4-8ff804eaecbe', 'volume_name': 'volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f5c097-e45d-4e49-8c60-c7afa5618d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f5c097-e45d-4e49-8c60-c7afa5618d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa855169-dc43-4dc4-9449-f222451f3ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:34 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Volume 9911ef7d-686f-4155-b6b4-8ff804eaecbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe', 'volume_size': 1} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:34 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd 1073741824" returned: 0 in 0.628s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:34 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd Jul 21 17:24:34 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:35 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd" returned: 0 in 0.345s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-786155922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9911ef7d-686f-4155-b6b4-8ff804eaecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af55faeaca484119aa644462702ef187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:34Z,use_quota=True,user_id='0f0191e374b64387a82853af4b658642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Creating volume 9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:35 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf62b789-5b21-4fcb-a622-26a99977b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:35 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe 1073741824 Jul 21 17:24:35 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a03ac4-65dc-4531-af1c-eb9a6e3a1d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Volume volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd (ee3b0387-d5ae-4ca6-a46c-1660677060cd): created successfully Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a03ac4-65dc-4531-af1c-eb9a6e3a1d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Flow 'volume_create_manager' (2ab8a32a-0d43-47f5-8f0d-596b7c338eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:35 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f7872718-4711-443d-9b82-9e27ebf161d7 tempest-VolumesListAdminTestJSON-286702982 None] Created volume successfully. Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-a28bf82e-f5f8-45b2-9960-0b75d9c49b98 req-e085635d-5331-433f-ac52-39858d029fdd tempest-TestShelveInstance-810845451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:35 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe 1073741824" returned: 0 in 0.620s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:35 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe Jul 21 17:24:35 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:36 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-a28bf82e-f5f8-45b2-9960-0b75d9c49b98 req-e085635d-5331-433f-ac52-39858d029fdd tempest-TestShelveInstance-810845451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.897s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa855169-dc43-4dc4-9449-f222451f3ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3a0239-c079-4897-b9be-df5b1ab02da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-a28bf82e-f5f8-45b2-9960-0b75d9c49b98 req-e085635d-5331-433f-ac52-39858d029fdd tempest-TestShelveInstance-810845451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Volume volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe (9911ef7d-686f-4155-b6b4-8ff804eaecbe): created successfully Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3a0239-c079-4897-b9be-df5b1ab02da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Flow 'volume_create_manager' (e8367696-0c15-4995-8f2f-cb720a7b9228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b172c96d-f2d1-488b-8722-b435f9764487 tempest-VolumesExtendTest-847204164 None] Created volume successfully. Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-a28bf82e-f5f8-45b2-9960-0b75d9c49b98 req-e085635d-5331-433f-ac52-39858d029fdd tempest-TestShelveInstance-810845451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-19c6ea17-b837-4583-beb2-8a4d06444dc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3f33ceb-7d8b-4465-b03d-4aee498b59bb', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:24:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-a28bf82e-f5f8-45b2-9960-0b75d9c49b98 req-e085635d-5331-433f-ac52-39858d029fdd tempest-TestShelveInstance-810845451 None] attachment_update completed successfully. Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Flow 'volume_create_manager' (6a653f9d-8224-448e-b944-6f4004af10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36a51f6-9fb5-4ec5-ba8a-0e5e97b9dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36a51f6-9fb5-4ec5-ba8a-0e5e97b9dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-590910094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30eb8e17-7b32-4334-b060-3191cd56d0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a172ca0d30b43f082835f7c9b64f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:37Z,use_quota=True,user_id='b6471626e635428cbed0cbfd1e4a270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62641748-58c5-4e39-b2e2-bc47327ab031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62641748-58c5-4e39-b2e2-bc47327ab031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a201a8-d8c6-4c90-ad82-61ec384f838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a201a8-d8c6-4c90-ad82-61ec384f838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30eb8e17-7b32-4334-b060-3191cd56d0a7', 'volume_name': 'volume-30eb8e17-7b32-4334-b060-3191cd56d0a7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc54487-69d8-4b11-9ae3-f071cf085ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc54487-69d8-4b11-9ae3-f071cf085ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bd22b1-c878-4d3c-98c9-62d532bce2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Volume 30eb8e17-7b32-4334-b060-3191cd56d0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30eb8e17-7b32-4334-b060-3191cd56d0a7', 'volume_size': 1} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-590910094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30eb8e17-7b32-4334-b060-3191cd56d0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a172ca0d30b43f082835f7c9b64f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:37Z,use_quota=True,user_id='b6471626e635428cbed0cbfd1e4a270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Creating volume 30eb8e17-7b32-4334-b060-3191cd56d0a7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:36 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:37 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 1073741824 Jul 21 17:24:37 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:37 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 1073741824" returned: 0 in 0.515s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:37 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 Jul 21 17:24:37 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:37 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7" returned: 0 in 0.344s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.855s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bd22b1-c878-4d3c-98c9-62d532bce2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30eb8e17-7b32-4334-b060-3191cd56d0a7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680458da-d9b8-41be-8d9c-3b49a991603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Creating offline snapshot cd8be23c-1aa5-4be6-b94a-a5c09a3534ad of volume 9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:24:37 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Volume volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 (30eb8e17-7b32-4334-b060-3191cd56d0a7): created successfully Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680458da-d9b8-41be-8d9c-3b49a991603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Flow 'volume_create_manager' (6a653f9d-8224-448e-b944-6f4004af10d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0266b3b-9f33-4f5b-97a3-7bc50075d35b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c7930315-352b-48d3-9627-932b3a7b166d tempest-VolumesListAdminTestJSON-286702982 None] Created volume successfully. Jul 21 17:24:38 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe Jul 21 17:24:38 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:38 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe" returned: 0 in 0.509s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:38 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad 1G Jul 21 17:24:38 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:39 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad 1G" returned: 0 in 0.852s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:39 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad Jul 21 17:24:39 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:39 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" returned: 0 in 0.603s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:39 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad is being set with open permissions: ugo+rw Jul 21 17:24:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:40 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad Jul 21 17:24:40 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Flow 'volume_create_manager' (92166ebc-22b9-4250-ac39-d7978aa15b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172aa7b2-1887-45fb-9ab1-0be2f0f090da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172aa7b2-1887-45fb-9ab1-0be2f0f090da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31139fb1-354b-4221-8d9c-40b1673a904a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00421d88fac94acba5bec45443016cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:40Z,use_quota=True,user_id='738d2dcb013d469db7dfe2b89955872c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32daaa68-024a-4fd4-8995-4200f12ac1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32daaa68-024a-4fd4-8995-4200f12ac1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7982e2-36b5-494b-9046-225bdcb0a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7982e2-36b5-494b-9046-225bdcb0a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31139fb1-354b-4221-8d9c-40b1673a904a', 'volume_name': 'volume-31139fb1-354b-4221-8d9c-40b1673a904a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc6eecd-da90-4c8c-b03a-d4239c302f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc6eecd-da90-4c8c-b03a-d4239c302f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3e02c-002c-43f2-b168-b11cf6ca2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:40 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Volume 31139fb1-354b-4221-8d9c-40b1673a904a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31139fb1-354b-4221-8d9c-40b1673a904a', 'volume_size': 1} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:40 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" returned: 0 in 0.477s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:40 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info Jul 21 17:24:40 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:40 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info" returned: 0 in 0.325s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:40 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info is being set with open permissions: ugo+rw Jul 21 17:24:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:40 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info Jul 21 17:24:40 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:41 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.info" returned: 0 in 0.416s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.325s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31139fb1-354b-4221-8d9c-40b1673a904a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00421d88fac94acba5bec45443016cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:40Z,use_quota=True,user_id='738d2dcb013d469db7dfe2b89955872c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Creating volume 31139fb1-354b-4221-8d9c-40b1673a904a {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:41 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:41 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a 1073741824 Jul 21 17:24:41 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-58585636-51f0-4e9e-9e8f-00ee62286da5 tempest-VolumesExtendTest-847204164 None] Create snapshot completed successfully Jul 21 17:24:41 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a 1073741824" returned: 0 in 0.585s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:41 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a Jul 21 17:24:41 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:42 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:42 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:42 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a" returned: 0 in 0.509s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3e02c-002c-43f2-b168-b11cf6ca2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31139fb1-354b-4221-8d9c-40b1673a904a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37faa3a6-d7fc-4793-96dd-70db1081cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:42 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Volume volume-31139fb1-354b-4221-8d9c-40b1673a904a (31139fb1-354b-4221-8d9c-40b1673a904a): created successfully Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37faa3a6-d7fc-4793-96dd-70db1081cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Flow 'volume_create_manager' (92166ebc-22b9-4250-ac39-d7978aa15b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:42 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-31958ff7-c0e7-48a1-8d92-9e5d32c0ffcd tempest-VolumesListAdminTestJSON-1785767187 None] Created volume successfully. Jul 21 17:24:42 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.516s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf35f5bc-47de-456d-ab8b-03b690f647a9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:43 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe Jul 21 17:24:43 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:43 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe" returned: 0 in 0.757s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad 2G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Acquiring lock "cinder-31139fb1-354b-4221-8d9c-40b1673a904a-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Lock "cinder-31139fb1-354b-4221-8d9c-40b1673a904a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad 2G" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.181s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Acquiring lock "cinder-quobyte-31139fb1-354b-4221-8d9c-40b1673a904a" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Lock "cinder-quobyte-31139fb1-354b-4221-8d9c-40b1673a904a" acquired by "delete_volume" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fe26ab53-e2da-4b86-b874-5fe85849caf8 tempest-VolumesExtendTest-847204164 None] Extend volume completed successfully. Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51ce4fa-9e55-41f6-80b2-21c075cda459]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "cinder-30eb8e17-7b32-4334-b060-3191cd56d0a7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-30eb8e17-7b32-4334-b060-3191cd56d0a7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "cinder-quobyte-30eb8e17-7b32-4334-b060-3191cd56d0a7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-quobyte-30eb8e17-7b32-4334-b060-3191cd56d0a7" acquired by "delete_volume" :: waited 0.038s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca2b5f-57cc-4fec-aea1-43b69f33a565]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:44 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a Jul 21 17:24:44 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:44 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 Jul 21 17:24:44 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:44 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a" returned: 0 in 0.855s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:45 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a Jul 21 17:24:45 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:45 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Acquiring lock "cinder-9a780e4b-c352-429f-aac1-10391cc6d93b-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7" returned: 0 in 0.723s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Lock "cinder-9a780e4b-c352-429f-aac1-10391cc6d93b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:45 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7 Jul 21 17:24:45 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Acquiring lock "cinder-quobyte-9a780e4b-c352-429f-aac1-10391cc6d93b" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Lock "cinder-quobyte-9a780e4b-c352-429f-aac1-10391cc6d93b" acquired by "delete_volume" :: waited 0.038s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ffc35-2a46-4c92-bf94-f2bb9aeb4b3d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-cd8be23c-1aa5-4be6-b94a-a5c09a3534ad-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Lock "cinder-cd8be23c-1aa5-4be6-b94a-a5c09a3534ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-quobyte-9911ef7d-686f-4155-b6b4-8ff804eaecbe" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:45 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-31139fb1-354b-4221-8d9c-40b1673a904a" returned: 0 in 0.586s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:45 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b Jul 21 17:24:45 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-9911ef7d-686f-4155-b6b4-8ff804eaecbe" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-quobyte-cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Lock "cinder-quobyte-31139fb1-354b-4221-8d9c-40b1673a904a" released by "delete_volume" :: held 1.562s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Deleting offline snapshot cd8be23c-1aa5-4be6-b94a-a5c09a3534ad of volume 9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] snapshot_file for this snap is: volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f59f5-aa13-441b-a448-eb9cd1a1c577]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Created reservations ['45f375c8-b0e2-4d01-bae9-a7cbec7eab8e', 'a7da0162-16f6-45b4-91a5-f48c00cf5f4a', '30d42462-0fa8-4d4f-9962-60258eb8ebd6', '9d412454-addc-4b47-b8ff-83625189465e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:45 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-30eb8e17-7b32-4334-b060-3191cd56d0a7" returned: 0 in 0.746s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-quobyte-30eb8e17-7b32-4334-b060-3191cd56d0a7" released by "delete_volume" :: held 1.575s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:46 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:46 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad Jul 21 17:24:46 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b" returned: 0 in 0.749s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:46 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:46 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Created reservations ['bcce0d96-bdd2-476f-a769-eb8e907334cb', 'bb2c0ebf-5d6d-437f-a90c-0eb24951fa4c', '324d18ea-87d1-4052-a7e0-fd61b9686acf', '30d891fc-07ef-428e-ab91-fade0e1c5f38'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:46 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b Jul 21 17:24:46 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=159,cinder:DELETE=11,cinder:SELECT=135,cinder:INSERT=63 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=142,cinder:INSERT=49,cinder:UPDATE=178,cinder:DELETE=18 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:46 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:46 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:46 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" returned: 0 in 0.791s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1304f-859d-4acf-a34d-4399a028d008]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:46 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9a780e4b-c352-429f-aac1-10391cc6d93b" returned: 0 in 0.611s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:46 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.669s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Lock "cinder-quobyte-9a780e4b-c352-429f-aac1-10391cc6d93b" released by "delete_volume" :: held 1.457s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Deleted volume successfully. Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "cinder-ee3b0387-d5ae-4ca6-a46c-1660677060cd-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:46 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe Jul 21 17:24:46 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-ee3b0387-d5ae-4ca6-a46c-1660677060cd-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:46 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d0ace9a-4ac1-4547-9454-51ebcdf53a25 tempest-VolumesListAdminTestJSON-1785767187 None] Lock "cinder-31139fb1-354b-4221-8d9c-40b1673a904a-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.594s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:46 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Deleted volume successfully. Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "cinder-quobyte-ee3b0387-d5ae-4ca6-a46c-1660677060cd" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f834534-c1b5-46d6-9f3a-62c22e3d0fd0 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-30eb8e17-7b32-4334-b060-3191cd56d0a7-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Created reservations ['bbc2e876-daa2-48e4-88ce-e86fdbba968e', '7e563a48-b78f-4961-a492-8a23da6e760c', '6e435d76-ff33-40ec-a129-b08ec6242e41', 'f80e64f6-d152-4976-8ca5-6d8c28509262'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-quobyte-ee3b0387-d5ae-4ca6-a46c-1660677060cd" acquired by "delete_volume" :: waited 0.053s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[505711f4-bad5-4d28-9c4a-06a393c1926c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:47 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:47 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:47 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd Jul 21 17:24:47 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:47 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe" returned: 0 in 0.747s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:47 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad Jul 21 17:24:47 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:47 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.421s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Deleted volume successfully. Jul 21 17:24:47 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd" returned: 0 in 0.553s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-733c3e8e-d896-4a41-af70-120faa010c89 tempest-VolumesNegativeTest-1001100492 None] Lock "cinder-9a780e4b-c352-429f-aac1-10391cc6d93b-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:47 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd Jul 21 17:24:47 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:47 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" returned: 0 in 0.606s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:47 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad Jul 21 17:24:47 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:48 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee3b0387-d5ae-4ca6-a46c-1660677060cd" returned: 0 in 0.440s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-quobyte-ee3b0387-d5ae-4ca6-a46c-1660677060cd" released by "delete_volume" :: held 1.051s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Created reservations ['bdffde81-e7bf-4a17-9d98-f40b0e113071', 'aab58848-8e84-4400-bafc-26ad9c7856f6', '1dc43e9d-7070-40cd-ad62-65b809289330', 'ae9ad088-bf89-49e7-90ec-50534ece78ee'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:48 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe.cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:48 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:48 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-cd8be23c-1aa5-4be6-b94a-a5c09a3534ad" released by "_delete_snapshot" :: held 2.671s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-9911ef7d-686f-4155-b6b4-8ff804eaecbe" released by "delete_snapshot" :: held 2.753s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Created reservations ['e57e80e2-4d3d-47ff-96b8-4deba62f017d', 'd6a1a5dc-ea27-4311-9158-9b839d1a77f6', '808efd54-d461-418b-910b-2be2a193a741', '96780689-ca52-4ffb-88ce-e03885625c53'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Delete snapshot completed successfully. Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7bc0a6e0-1634-45b8-9096-0e9a0d33613a tempest-VolumesExtendTest-847204164 None] Lock "cinder-cd8be23c-1aa5-4be6-b94a-a5c09a3534ad-delete_snapshot" released by "delete_snapshot" :: held 2.959s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:48 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Deleted volume successfully. Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-bfcb546a-871a-49ba-9a86-958925bd38c9 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-ee3b0387-d5ae-4ca6-a46c-1660677060cd-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-9911ef7d-686f-4155-b6b4-8ff804eaecbe-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Lock "cinder-9911ef7d-686f-4155-b6b4-8ff804eaecbe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Acquiring lock "cinder-quobyte-9911ef7d-686f-4155-b6b4-8ff804eaecbe" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-9911ef7d-686f-4155-b6b4-8ff804eaecbe" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d72d62f-e643-429e-8e53-3b03b321176c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:49 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe Jul 21 17:24:49 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "cinder-f8936be5-e0c2-4b65-8533-195ed6e319c8-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-f8936be5-e0c2-4b65-8533-195ed6e319c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "cinder-quobyte-f8936be5-e0c2-4b65-8533-195ed6e319c8" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-quobyte-f8936be5-e0c2-4b65-8533-195ed6e319c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b35aff-427c-40bc-a69c-8bd5305e20ca]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:49 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 Jul 21 17:24:49 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:49 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe" returned: 0 in 0.518s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:49 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe Jul 21 17:24:49 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:49 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8" returned: 0 in 0.492s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:49 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9911ef7d-686f-4155-b6b4-8ff804eaecbe" returned: 0 in 0.286s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:49 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8 Jul 21 17:24:49 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Lock "cinder-quobyte-9911ef7d-686f-4155-b6b4-8ff804eaecbe" released by "delete_volume" :: held 0.871s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:49 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Created reservations ['6be25190-8577-46bd-9b76-88ac292577fc', '9b99c252-73c6-4d93-9f64-8c9867795b5c', '51fffa19-ec01-4ee3-adaf-6efab78904b4', '530bfb71-57bf-4831-a14c-5ca369a76772'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:50 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:50 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:50 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f8936be5-e0c2-4b65-8533-195ed6e319c8" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-quobyte-f8936be5-e0c2-4b65-8533-195ed6e319c8" released by "delete_volume" :: held 0.878s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Created reservations ['52bce0d4-3491-4f64-ac90-610620bb4acb', '30a756ca-9245-4d4b-b3f7-7e7d18176a70', '01ccf0be-876d-402c-a85a-a76058560498', '7c7042e2-b296-48ee-9f2c-6287cb5265db'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:50 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:24:50 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:50 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.483s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:50 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Deleted volume successfully. Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ebf33179-38f5-4656-bee2-4162ddf100a5 tempest-VolumesExtendTest-847204164 None] Lock "cinder-9911ef7d-686f-4155-b6b4-8ff804eaecbe-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:50 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.460s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:24:50 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Deleted volume successfully. Jul 21 17:24:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-96bf8170-b3fe-42e4-ab94-75b94f2a6533 tempest-VolumesListAdminTestJSON-286702982 None] Lock "cinder-f8936be5-e0c2-4b65-8533-195ed6e319c8-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Flow 'volume_create_manager' (f3a7b82e-3ea3-4840-954a-8620545ad66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0c3640-8250-4c90-8ed4-a3af8d333032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0c3640-8250-4c90-8ed4-a3af8d333032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1180110846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad841b3-3aa1-4737-b062-fe4f08b08f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d79bbe55aa544859afbfdec16635cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:58Z,use_quota=True,user_id='b77322a4519641fe9acea13b82eeb87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468c1844-a7e6-4aeb-80f8-ec04ee096795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468c1844-a7e6-4aeb-80f8-ec04ee096795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4418a23f-c9a1-45d5-8265-c91089f5edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4418a23f-c9a1-45d5-8265-c91089f5edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad841b3-3aa1-4737-b062-fe4f08b08f2a', 'volume_name': 'volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2af8de2-76cb-4632-aa0d-1dff2edc32aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2af8de2-76cb-4632-aa0d-1dff2edc32aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43e991f-3a9e-491f-b34b-36ee7c16d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:58 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Volume 4ad841b3-3aa1-4737-b062-fe4f08b08f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a', 'volume_size': 1} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1180110846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad841b3-3aa1-4737-b062-fe4f08b08f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d79bbe55aa544859afbfdec16635cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:24:58Z,use_quota=True,user_id='b77322a4519641fe9acea13b82eeb87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Creating volume 4ad841b3-3aa1-4737-b062-fe4f08b08f2a {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:24:58 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:24:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:58 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a 1073741824 Jul 21 17:24:58 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:59 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a 1073741824" returned: 0 in 0.637s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:24:59 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a Jul 21 17:24:59 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:24:59 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43e991f-3a9e-491f-b34b-36ee7c16d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415d7c2a-709e-413b-b57c-2c0196c0f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:24:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Volume volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a (4ad841b3-3aa1-4737-b062-fe4f08b08f2a): created successfully Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415d7c2a-709e-413b-b57c-2c0196c0f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:24:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Flow 'volume_create_manager' (f3a7b82e-3ea3-4840-954a-8620545ad66f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:24:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3ae4c0a0-6e7b-44d2-929f-48d518d4f145 tempest-AbsoluteLimitsTests-731514061 None] Created volume successfully. Jul 21 17:25:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Acquiring lock "cinder-4ad841b3-3aa1-4737-b062-fe4f08b08f2a-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Lock "cinder-4ad841b3-3aa1-4737-b062-fe4f08b08f2a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Acquiring lock "cinder-quobyte-4ad841b3-3aa1-4737-b062-fe4f08b08f2a" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Lock "cinder-quobyte-4ad841b3-3aa1-4737-b062-fe4f08b08f2a" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f2910-73dd-4f74-96d7-a28ce1afc472]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:01 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a Jul 21 17:25:01 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:01 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a" returned: 0 in 0.422s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:01 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a Jul 21 17:25:01 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:01 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4ad841b3-3aa1-4737-b062-fe4f08b08f2a" returned: 0 in 0.324s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Lock "cinder-quobyte-4ad841b3-3aa1-4737-b062-fe4f08b08f2a" released by "delete_volume" :: held 0.794s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Created reservations ['ffd252d0-7039-48c1-86ed-9093fa6fd67a', '251fe2a8-10ac-446a-b271-ee61690b653c', '6367a1b9-6b58-4e9c-af4e-28cc85283169', '4f026622-e7a1-495c-a44d-1457ebc39627'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:01 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:25:01 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:02 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.301s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:02 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:25:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Deleted volume successfully. Jul 21 17:25:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac0e7f1c-b892-4327-82c4-e1693c24ef0b tempest-AbsoluteLimitsTests-731514061 None] Lock "cinder-4ad841b3-3aa1-4737-b062-fe4f08b08f2a-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:11 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=62,cinder:SELECT=31,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (01a965f8-a605-488a-b8d3-a1f3ef4b173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90dc395a-dc85-4395-89cc-b8ecf5ca55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90dc395a-dc85-4395-89cc-b8ecf5ca55fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-623070027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36027d65-e9b1-45c2-9f7b-13d3936a9594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:12Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e91cf94-832a-44e6-801a-55160ac68f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e91cf94-832a-44e6-801a-55160ac68f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6590fd-0b45-421e-b83e-d0f8e4230bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6590fd-0b45-421e-b83e-d0f8e4230bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36027d65-e9b1-45c2-9f7b-13d3936a9594', 'volume_name': 'volume-36027d65-e9b1-45c2-9f7b-13d3936a9594', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f10df1-8868-40c8-949d-c23651e88b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f10df1-8868-40c8-949d-c23651e88b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca59994-f3ec-48c6-8082-555e863298fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume 36027d65-e9b1-45c2-9f7b-13d3936a9594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36027d65-e9b1-45c2-9f7b-13d3936a9594', 'volume_size': 1} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-623070027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36027d65-e9b1-45c2-9f7b-13d3936a9594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:12Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Creating volume 36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:12 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:25:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:12 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 1073741824 Jul 21 17:25:12 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:13 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 1073741824" returned: 0 in 0.620s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:13 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 Jul 21 17:25:13 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:13 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594" returned: 0 in 0.583s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca59994-f3ec-48c6-8082-555e863298fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36027d65-e9b1-45c2-9f7b-13d3936a9594', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d24925-b846-4752-a118-1d4e2e050028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 (36027d65-e9b1-45c2-9f7b-13d3936a9594): created successfully Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d24925-b846-4752-a118-1d4e2e050028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (01a965f8-a605-488a-b8d3-a1f3ef4b173d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-768aa816-ee93-4ff5-bf5a-655a219280f3 tempest-VolumesSnapshotTestJSON-1326394460 None] Created volume successfully. Jul 21 17:25:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-ae0dc054-0543-4cc1-99a9-1c202e0f760a req-6c45beea-7605-4513-b65c-aab1dd1a1add tempest-TestShelveInstance-810845451 None] Terminate volume connection completed successfully. Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-ae0dc054-0543-4cc1-99a9-1c202e0f760a req-6c45beea-7605-4513-b65c-aab1dd1a1add tempest-TestShelveInstance-810845451 None] Deleting attachment c3f33ceb-7d8b-4465-b03d-4aee498b59bb. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Flow 'volume_create_manager' (a59630b9-5030-4f63-b489-df16dc4b3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6aec0c-aa17-4781-97f0-fc8fc795c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6aec0c-aa17-4781-97f0-fc8fc795c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1507526026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64bf048-14ac-4972-a813-de8d2693f821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa0b0ea4d7f4c32a0ec043c23fc9cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:15Z,use_quota=True,user_id='1d7432faca5e4ae78315f807ce55ffe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65bfd58-d79d-4480-a474-d2df10d9fbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65bfd58-d79d-4480-a474-d2df10d9fbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a328d2-56f5-41eb-8a9c-942414f4f8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a328d2-56f5-41eb-8a9c-942414f4f8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64bf048-14ac-4972-a813-de8d2693f821', 'volume_name': 'volume-c64bf048-14ac-4972-a813-de8d2693f821', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50be727a-d5a6-4ddc-8c06-52a4f4b338e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50be727a-d5a6-4ddc-8c06-52a4f4b338e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4f69b-200d-48fb-8aa4-277713d78f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Volume c64bf048-14ac-4972-a813-de8d2693f821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64bf048-14ac-4972-a813-de8d2693f821', 'volume_size': 1} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1507526026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64bf048-14ac-4972-a813-de8d2693f821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa0b0ea4d7f4c32a0ec043c23fc9cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:15Z,use_quota=True,user_id='1d7432faca5e4ae78315f807ce55ffe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Creating volume c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:14 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:25:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:14 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 1073741824 Jul 21 17:25:14 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:15 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 1073741824" returned: 0 in 0.572s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:15 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 Jul 21 17:25:15 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:15 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.767s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Creating offline snapshot 51b848f0-d514-4e4b-a6cc-b7f38c258c15 of volume 36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4f69b-200d-48fb-8aa4-277713d78f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64bf048-14ac-4972-a813-de8d2693f821', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f114b1a-63a6-4b60-a8c5-3a4f687efce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab088375-d97b-4e7f-b11e-d188ab9c5a17]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Volume volume-c64bf048-14ac-4972-a813-de8d2693f821 (c64bf048-14ac-4972-a813-de8d2693f821): created successfully Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f114b1a-63a6-4b60-a8c5-3a4f687efce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Flow 'volume_create_manager' (a59630b9-5030-4f63-b489-df16dc4b3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e3291f94-41c6-4ae1-8ff0-9d0d5b196eb2 tempest-VolumesDeleteCascade-985560813 None] Created volume successfully. Jul 21 17:25:16 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 Jul 21 17:25:16 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:16 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594" returned: 0 in 0.432s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:16 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 1G Jul 21 17:25:16 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:16 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 1G" returned: 0 in 0.558s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:16 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 Jul 21 17:25:16 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:17 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15" returned: 0 in 0.330s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:17 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 is being set with open permissions: ugo+rw Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:17 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 Jul 21 17:25:17 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:17 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:17 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info Jul 21 17:25:17 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-06e6cddd-fc66-4a96-acc1-9e0ef772b516 req-9a539221-623d-4438-8cf1-d52813aa56ab tempest-TestShelveInstance-810845451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:17 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info" returned: 0 in 0.300s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:17 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info is being set with open permissions: ugo+rw Jul 21 17:25:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:17 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info Jul 21 17:25:17 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:18 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.info" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.249s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Creating offline snapshot c3faa99e-ee66-43ae-94b2-de0c98d529dc of volume c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[92763d91-7c85-433b-86a0-f5f25e80890a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0f70c121-35fc-40f8-92d5-3a3ef77a1635 tempest-VolumesSnapshotTestJSON-1326394460 None] Create snapshot completed successfully Jul 21 17:25:18 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 Jul 21 17:25:18 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:18 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:18 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc 1G Jul 21 17:25:18 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:19 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc 1G" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64bf048-14ac-4972-a813-de8d2693f821 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:19 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64bf048-14ac-4972-a813-de8d2693f821 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:19 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-51b848f0-d514-4e4b-a6cc-b7f38c258c15-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-51b848f0-d514-4e4b-a6cc-b7f38c258c15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-36027d65-e9b1-45c2-9f7b-13d3936a9594" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:19 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-36027d65-e9b1-45c2-9f7b-13d3936a9594" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-51b848f0-d514-4e4b-a6cc-b7f38c258c15" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64bf048-14ac-4972-a813-de8d2693f821 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.350s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:19 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc is being set with open permissions: ugo+rw Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-51b848f0-d514-4e4b-a6cc-b7f38c258c15" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:19 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:19 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Deleting offline snapshot 51b848f0-d514-4e4b-a6cc-b7f38c258c15 of volume 36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] snapshot_file for this snap is: volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[09312592-589c-40ac-b9b9-f8c3e68863b0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:19 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 Jul 21 17:25:19 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:19 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.304s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:19 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info Jul 21 17:25:19 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:20 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15" returned: 0 in 0.440s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36027d65-e9b1-45c2-9f7b-13d3936a9594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d29f5b-c7f8-49ee-be5c-8b0f89de66b9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:20 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 Jul 21 17:25:20 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:20 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:20 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info is being set with open permissions: ugo+rw Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:20 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info Jul 21 17:25:20 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:20 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.info" returned: 0 in 0.249s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:20 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-06e6cddd-fc66-4a96-acc1-9e0ef772b516 req-9a539221-623d-4438-8cf1-d52813aa56ab tempest-TestShelveInstance-810845451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.718s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594" returned: 0 in 0.418s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-06e6cddd-fc66-4a96-acc1-9e0ef772b516 req-9a539221-623d-4438-8cf1-d52813aa56ab tempest-TestShelveInstance-810845451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:20 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 Jul 21 17:25:20 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-110f6d00-e64f-45a8-a9c7-1e0b2fbd0758 tempest-VolumesDeleteCascade-985560813 None] Create snapshot completed successfully Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-06e6cddd-fc66-4a96-acc1-9e0ef772b516 req-9a539221-623d-4438-8cf1-d52813aa56ab tempest-TestShelveInstance-810845451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-19c6ea17-b837-4583-beb2-8a4d06444dc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af16d7e9-ff7e-4c63-85b5-fce81cbae6a2', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:25:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-06e6cddd-fc66-4a96-acc1-9e0ef772b516 req-9a539221-623d-4438-8cf1-d52813aa56ab tempest-TestShelveInstance-810845451 None] attachment_update completed successfully. Jul 21 17:25:20 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15" returned: 0 in 0.449s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:20 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15 Jul 21 17:25:20 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:21 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594.51b848f0-d514-4e4b-a6cc-b7f38c258c15" returned: 0 in 0.435s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-51b848f0-d514-4e4b-a6cc-b7f38c258c15" released by "_delete_snapshot" :: held 1.883s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-36027d65-e9b1-45c2-9f7b-13d3936a9594" released by "delete_snapshot" :: held 1.926s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Creating offline snapshot 28559b94-1f66-4ade-94c9-ffe64bb99fc5 of volume c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['3d3c11fe-f1d1-4b6c-8054-c052750150f1', 'f0fe3bba-7647-4311-8ff2-759bf9525b45', '47ce2dcc-ad5f-42a1-a4fe-82134b1fe16c', 'f5d5532e-c3a8-4d0b-b0d6-9992a505ef69'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[85218372-545a-4920-9161-941d08905ed7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Delete snapshot completed successfully. Jul 21 17:25:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-486360e0-d31c-4b8f-80e3-5e251c911248 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-51b848f0-d514-4e4b-a6cc-b7f38c258c15-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:21 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:21 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:22 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.471s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c64bf048-14ac-4972-a813-de8d2693f821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:22 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 1G Jul 21 17:25:22 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:22 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 1G" returned: 0 in 0.531s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:22 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 Jul 21 17:25:22 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:23 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:23 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 is being set with open permissions: ugo+rw Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:23 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 Jul 21 17:25:23 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:23 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-83cfd4c0-9421-4bf5-be6c-63220e1a1538 tempest-VolumesDeleteCascade-985560813 None] Create snapshot completed successfully Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (d1099bac-7808-4901-ab0f-8ce871432304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7809d211-bd5d-4751-8180-d30e85591368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7809d211-bd5d-4751-8180-d30e85591368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-99020018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c81655-be65-4714-ad7a-f13949c173ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:23Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31ee74f-f8da-4d37-94a0-324c96fdd5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31ee74f-f8da-4d37-94a0-324c96fdd5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e4dcb-6e09-41c1-9844-ef8f1d5df6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e4dcb-6e09-41c1-9844-ef8f1d5df6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c81655-be65-4714-ad7a-f13949c173ae', 'volume_name': 'volume-e0c81655-be65-4714-ad7a-f13949c173ae', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a222aa-ee9d-41bc-aaec-70218b0e9cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a222aa-ee9d-41bc-aaec-70218b0e9cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7e8326-72ae-459a-aaff-31712fd7c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume e0c81655-be65-4714-ad7a-f13949c173ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c81655-be65-4714-ad7a-f13949c173ae', 'volume_size': 1} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-99020018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c81655-be65-4714-ad7a-f13949c173ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:23Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Creating volume e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:23 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:23 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae 1073741824 Jul 21 17:25:23 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-c64bf048-14ac-4972-a813-de8d2693f821-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-c64bf048-14ac-4972-a813-de8d2693f821-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Performing cascade delete. {{(pid=87591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-28559b94-1f66-4ade-94c9-ffe64bb99fc5-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-28559b94-1f66-4ade-94c9-ffe64bb99fc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-28559b94-1f66-4ade-94c9-ffe64bb99fc5" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-28559b94-1f66-4ade-94c9-ffe64bb99fc5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Deleting offline snapshot 28559b94-1f66-4ade-94c9-ffe64bb99fc5 of volume c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] snapshot_file for this snap is: volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[298e70a7-791d-42c7-bc39-d8528900c45c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:24 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 Jul 21 17:25:24 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:24 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae 1073741824" returned: 0 in 0.898s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:24 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:24 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:24 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5" returned: 0 in 0.761s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c64bf048-14ac-4972-a813-de8d2693f821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fec0ac2-66b2-4820-b5e1-8f98d8d93449]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:25 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.516s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7e8326-72ae-459a-aaff-31712fd7c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c81655-be65-4714-ad7a-f13949c173ae', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12cfecd-3674-4acc-bc08-75dc320b59c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume volume-e0c81655-be65-4714-ad7a-f13949c173ae (e0c81655-be65-4714-ad7a-f13949c173ae): created successfully Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12cfecd-3674-4acc-bc08-75dc320b59c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:25 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (d1099bac-7808-4901-ab0f-8ce871432304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:25 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-027758f3-64d9-447d-8ea9-ef7cdca63d41 tempest-VolumesSnapshotTestJSON-1326394460 None] Created volume successfully. Jul 21 17:25:25 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.616s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c64bf048-14ac-4972-a813-de8d2693f821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:25 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 Jul 21 17:25:25 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Creating offline snapshot ea390285-9eb4-449a-aa3b-65da0b463c02 of volume e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a6dcd-1de1-4a34-b698-b21849c600bd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:26 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5" returned: 0 in 0.562s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:26 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5 Jul 21 17:25:26 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:26 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:26 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:26 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.28559b94-1f66-4ade-94c9-ffe64bb99fc5" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-28559b94-1f66-4ade-94c9-ffe64bb99fc5" released by "_delete_snapshot" :: held 2.427s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" released by "delete_snapshot" :: held 2.471s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Created reservations ['9222f446-8c11-4efc-a2f6-6a33d487ecf2', 'eb4384c6-30d4-4a47-85b6-2ac4a6ba4049', '2ef104bf-e3bf-4962-9792-1fe0b7a9492d', 'c4d72096-927c-4c40-9524-e315c9fa809f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:26 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Delete snapshot completed successfully. Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.612s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-28559b94-1f66-4ade-94c9-ffe64bb99fc5-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-c3faa99e-ee66-43ae-94b2-de0c98d529dc-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:26 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 1G Jul 21 17:25:26 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-c3faa99e-ee66-43ae-94b2-de0c98d529dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-c3faa99e-ee66-43ae-94b2-de0c98d529dc" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c3faa99e-ee66-43ae-94b2-de0c98d529dc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Deleting offline snapshot c3faa99e-ee66-43ae-94b2-de0c98d529dc of volume c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] snapshot_file for this snap is: volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6305ec29-ca73-4272-9bc0-4d6a9f41aa71]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:27 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:27 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:27 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 1G" returned: 0 in 0.654s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0c81655-be65-4714-ad7a-f13949c173ae -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:27 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0c81655-be65-4714-ad7a-f13949c173ae -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 Jul 21 17:25:27 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:27 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.625s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c64bf048-14ac-4972-a813-de8d2693f821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf559ad-ceea-49fe-bf72-399598798c3e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:27 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 Jul 21 17:25:27 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:27 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0c81655-be65-4714-ad7a-f13949c173ae -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02" returned: 0 in 0.438s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:27 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 is being set with open permissions: ugo+rw Jul 21 17:25:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:27 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 Jul 21 17:25:27 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:28 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:28 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:28 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:28 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:28 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info Jul 21 17:25:28 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:28 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info" returned: 0 in 0.370s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:28 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info is being set with open permissions: ugo+rw Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:28 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info Jul 21 17:25:28 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:28 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.551s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:28 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc Jul 21 17:25:28 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:28 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.info" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e246db6c-e876-4a6c-97d0-40d4a6316adc tempest-VolumesSnapshotTestJSON-1326394460 None] Create snapshot completed successfully Jul 21 17:25:28 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821.c3faa99e-ee66-43ae-94b2-de0c98d529dc" returned: 0 in 0.414s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c3faa99e-ee66-43ae-94b2-de0c98d529dc" released by "_delete_snapshot" :: held 2.257s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" released by "delete_snapshot" :: held 2.285s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Created reservations ['06d4ac06-310e-4f3c-ab26-c8bd6b2532fa', '05b8007f-d48f-461c-97b9-52678fd804c8', '1647333a-d257-4953-8bcd-d763279b5725', '368c79ef-3d6d-4b1c-a2ad-32e705b23fe8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Delete snapshot completed successfully. Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-c3faa99e-ee66-43ae-94b2-de0c98d529dc-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Snapshots deleted, issuing volume delete {{(pid=87591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[96685698-bea8-4ea1-b9f4-feb4ae9de6fa]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:29 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 Jul 21 17:25:29 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:30 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821" returned: 0 in 0.810s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:30 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821 Jul 21 17:25:30 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (24beb7b1-2623-4d28-bbb2-843e7b931d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d32dc69-ed9d-4e15-8c55-4906b206eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d32dc69-ed9d-4e15-8c55-4906b206eba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1974534836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dacd7df-010e-4119-b905-f831cb655d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ea390285-9eb4-449a-aa3b-65da0b463c02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:30Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcd6264-6927-4174-b09f-13b7303410bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcd6264-6927-4174-b09f-13b7303410bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54240ea8-f4b6-4a8e-a583-6ae850cd96e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54240ea8-f4b6-4a8e-a583-6ae850cd96e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9dacd7df-010e-4119-b905-f831cb655d60', 'volume_name': 'volume-9dacd7df-010e-4119-b905-f831cb655d60', 'volume_size': 2, 'snapshot_id': 'ea390285-9eb4-449a-aa3b-65da0b463c02'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503ae08a-f4c6-45c1-995c-8a0e6354f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503ae08a-f4c6-45c1-995c-8a0e6354f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1d5448-7340-4b40-97b3-85c206880152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Volume 9dacd7df-010e-4119-b905-f831cb655d60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9dacd7df-010e-4119-b905-f831cb655d60', 'volume_size': 2, 'snapshot_id': 'ea390285-9eb4-449a-aa3b-65da0b463c02'} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-ea390285-9eb4-449a-aa3b-65da0b463c02-9dacd7df-010e-4119-b905-f831cb655d60" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-ea390285-9eb4-449a-aa3b-65da0b463c02-9dacd7df-010e-4119-b905-f831cb655d60" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Creating volume 9dacd7df-010e-4119-b905-f831cb655d60 from snapshot ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-9dacd7df-010e-4119-b905-f831cb655d60" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-9dacd7df-010e-4119-b905-f831cb655d60" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] snapshot: ea390285-9eb4-449a-aa3b-65da0b463c02, volume: 9dacd7df-010e-4119-b905-f831cb655d60, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0045c17-c32d-402f-820d-820b5975d992]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:30 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c64bf048-14ac-4972-a813-de8d2693f821" returned: 0 in 0.747s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-c64bf048-14ac-4972-a813-de8d2693f821" released by "delete_volume" :: held 1.702s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Created reservations ['e4f9416d-9fa0-4a04-ad6b-f90073036b0d', '8c95e157-7fed-4e82-a492-9273ab5c1eae', 'd53d42ac-e2d7-4f4d-a0f9-8eab0539acb4', '42309edb-b628-46e9-8ffd-a759c1f81e2f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:31 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 Jul 21 17:25:31 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:31 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:25:31 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:31 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02" returned: 0 in 0.917s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0c81655-be65-4714-ad7a-f13949c173ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:25:31 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.497s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:25:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Deleted volume successfully. Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8465534d-38a1-4509-8b0c-adeaeed26821]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3506b754-5abb-4aa4-80bf-261ca6382975 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-c64bf048-14ac-4972-a813-de8d2693f821-delete_volume" released by "delete_volume" :: held 8.082s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:32 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:32 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:32 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.675s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:32 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:25:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:32 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 Jul 21 17:25:32 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Flow 'volume_create_manager' (3ce9220e-a8da-4fd9-ab7e-7b52f6e8af0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a6ff4d-817c-41ef-86fe-4bc5b4993049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a6ff4d-817c-41ef-86fe-4bc5b4993049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2019670334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947ad613-9c96-4d0b-92c5-f9a17a62fa32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa0b0ea4d7f4c32a0ec043c23fc9cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:33Z,use_quota=True,user_id='1d7432faca5e4ae78315f807ce55ffe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca5c481-feab-43ca-9cb7-d3f52d93833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca5c481-feab-43ca-9cb7-d3f52d93833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77d277a-e812-4adf-a074-95967e073ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77d277a-e812-4adf-a074-95967e073ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947ad613-9c96-4d0b-92c5-f9a17a62fa32', 'volume_name': 'volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0d8cd9-9493-4a93-bc31-8ea32b0fc948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0d8cd9-9493-4a93-bc31-8ea32b0fc948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361df314-4ffc-4421-93d3-9930f3f87343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:33 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Volume 947ad613-9c96-4d0b-92c5-f9a17a62fa32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32', 'volume_size': 1} Jul 21 17:25:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:41 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60" returned: 0 in 9.346s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc5efe-4a41-42e9-97e5-7a10b98d8ce3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:42 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:42 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:42 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:25:42 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:42 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:25:42 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.781s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae, size 1024.00 MB, duration 9.35 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:25:42 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Converted 1024.00 MB image at 109.56 MB/s Jul 21 17:25:42 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 is being set with open permissions: ugo+rw Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:42 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 Jul 21 17:25:42 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:42 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60" returned: 0 in 0.300s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-9dacd7df-010e-4119-b905-f831cb655d60" released by "_copy_volume_from_snapshot" :: held 12.236s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-ea390285-9eb4-449a-aa3b-65da0b463c02-9dacd7df-010e-4119-b905-f831cb655d60" released by "_create_volume_from_snapshot" :: held 12.294s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.330s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.720s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2019670334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947ad613-9c96-4d0b-92c5-f9a17a62fa32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa0b0ea4d7f4c32a0ec043c23fc9cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:33Z,use_quota=True,user_id='1d7432faca5e4ae78315f807ce55ffe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Creating volume 947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:25:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:43 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:43 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 1073741824 Jul 21 17:25:43 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1d5448-7340-4b40-97b3-85c206880152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dacd7df-010e-4119-b905-f831cb655d60', 'volume_size': 2, 'snapshot_id': 'ea390285-9eb4-449a-aa3b-65da0b463c02'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d01846c-792f-4b06-b63c-b98b843e9f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:43 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Volume volume-9dacd7df-010e-4119-b905-f831cb655d60 (9dacd7df-010e-4119-b905-f831cb655d60): created successfully Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d01846c-792f-4b06-b63c-b98b843e9f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (24beb7b1-2623-4d28-bbb2-843e7b931d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-250b9110-5900-4272-94d3-cb3f7a25c4af tempest-VolumesSnapshotTestJSON-1326394460 None] Created volume successfully. Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Flow 'volume_create_manager' (cb40b2b5-e75e-4203-82a7-22569c3639c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd073b3-c60d-415b-86ac-c164f9354e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-9dacd7df-010e-4119-b905-f831cb655d60-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd073b3-c60d-415b-86ac-c164f9354e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1777275213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5583a6-0963-4612-94ec-5ece86b944e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1279ae51e84109be8faa33142ec93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:44Z,use_quota=True,user_id='46931630ffa1478e9fe7d8aa34f105a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35c09e9-665b-4f45-8f99-42d5dc0b0210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35c09e9-665b-4f45-8f99-42d5dc0b0210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54eadfb5-c2e3-4fb8-9d39-427914fe27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54eadfb5-c2e3-4fb8-9d39-427914fe27b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5583a6-0963-4612-94ec-5ece86b944e3', 'volume_name': 'volume-3b5583a6-0963-4612-94ec-5ece86b944e3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51706288-d77e-4621-ad3c-fa8aee447e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51706288-d77e-4621-ad3c-fa8aee447e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db41a57-2e3a-4d00-8ac0-78bc8b7acd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:43 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Volume 3b5583a6-0963-4612-94ec-5ece86b944e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5583a6-0963-4612-94ec-5ece86b944e3', 'volume_size': 1} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-9dacd7df-010e-4119-b905-f831cb655d60-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:43 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 1073741824" returned: 0 in 0.746s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-9dacd7df-010e-4119-b905-f831cb655d60" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-9dacd7df-010e-4119-b905-f831cb655d60" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:43 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:25:43 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30737000-9e01-4eba-af86-99bb5433dec9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:44 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 Jul 21 17:25:44 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:44 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.285s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1777275213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5583a6-0963-4612-94ec-5ece86b944e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1279ae51e84109be8faa33142ec93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:44Z,use_quota=True,user_id='46931630ffa1478e9fe7d8aa34f105a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Creating volume 3b5583a6-0963-4612-94ec-5ece86b944e3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:44 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361df314-4ffc-4421-93d3-9930f3f87343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244562dd-64b8-4a20-ba23-68a2d37caf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:44 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 1073741824 Jul 21 17:25:44 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:44 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Volume volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 (947ad613-9c96-4d0b-92c5-f9a17a62fa32): created successfully Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244562dd-64b8-4a20-ba23-68a2d37caf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Flow 'volume_create_manager' (3ce9220e-a8da-4fd9-ab7e-7b52f6e8af0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-596d8bc1-1466-4610-b1bd-4aa5d7731072 tempest-VolumesDeleteCascade-985560813 None] Created volume successfully. Jul 21 17:25:44 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60" returned: 0 in 0.415s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:44 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60 Jul 21 17:25:44 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:44 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dacd7df-010e-4119-b905-f831cb655d60" returned: 0 in 0.269s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-9dacd7df-010e-4119-b905-f831cb655d60" released by "delete_volume" :: held 0.727s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['9a6c72c9-5876-4417-83ee-ae4de022a83e', '79e10368-71a0-4b20-a4dc-409a28943d4b', 'b313fb65-ddb2-4a92-8466-64d23337ed9c', '003925d3-6119-476c-b4af-de6192462d62'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:44 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 1073741824" returned: 0 in 0.519s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:44 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 Jul 21 17:25:44 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:44 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:25:44 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:45 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-ea390285-9eb4-449a-aa3b-65da0b463c02-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db41a57-2e3a-4d00-8ac0-78bc8b7acd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5583a6-0963-4612-94ec-5ece86b944e3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ef85e7-4eb5-4867-8f6b-fe95e6c177b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-ea390285-9eb4-449a-aa3b-65da0b463c02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-e0c81655-be65-4714-ad7a-f13949c173ae" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:45 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Volume volume-3b5583a6-0963-4612-94ec-5ece86b944e3 (3b5583a6-0963-4612-94ec-5ece86b944e3): created successfully Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ef85e7-4eb5-4867-8f6b-fe95e6c177b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Flow 'volume_create_manager' (cb40b2b5-e75e-4203-82a7-22569c3639c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-e0c81655-be65-4714-ad7a-f13949c173ae" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-ea390285-9eb4-449a-aa3b-65da0b463c02" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7aebd14a-05a0-4165-99eb-f2978eedc15f tempest-TestMinimumBasicScenario-951623835 None] Created volume successfully. Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-ea390285-9eb4-449a-aa3b-65da0b463c02" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Deleting offline snapshot ea390285-9eb4-449a-aa3b-65da0b463c02 of volume e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] snapshot_file for this snap is: volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96383a-2d08-4351-8b5f-0e59d892a569]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:45 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.531s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:25:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Deleted volume successfully. Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Creating offline snapshot 2cc126a2-e1c4-4402-b97f-0d140bb80798 of volume 947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1d924d55-4bec-454a-904a-418ddf997301 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-9dacd7df-010e-4119-b905-f831cb655d60-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baaea3c-e573-46a8-af60-162179c7a646]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:45 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 Jul 21 17:25:45 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:45 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:25:45 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:45 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02" returned: 0 in 0.462s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0c81655-be65-4714-ad7a-f13949c173ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:45 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.424s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b866a-779e-484d-aaa9-c52132b1bf85]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:45 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 1G Jul 21 17:25:45 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:45 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:45 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:46 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.522s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:46 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 Jul 21 17:25:46 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:46 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 1G" returned: 0 in 0.620s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:46 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 Jul 21 17:25:46 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-65047c55-8f17-496f-b24c-ad95ca3439cb req-27f599db-fbd1-48da-9eab-773478c9e5f4 tempest-TestMinimumBasicScenario-951623835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:46 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:46 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 is being set with open permissions: ugo+rw Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:46 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02" returned: 0 in 0.475s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:46 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 Jul 21 17:25:46 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:46 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02 Jul 21 17:25:46 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:46 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798" returned: 0 in 0.245s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:47 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae.ea390285-9eb4-449a-aa3b-65da0b463c02" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-ea390285-9eb4-449a-aa3b-65da0b463c02" released by "_delete_snapshot" :: held 1.912s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:47 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info Jul 21 17:25:47 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-e0c81655-be65-4714-ad7a-f13949c173ae" released by "delete_snapshot" :: held 1.977s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['d5e18086-1a92-4a6c-a4a1-dcd316d22ee1', 'b93c08fb-d3cc-43ec-b79d-054f78ad5026', 'ad0926b9-f077-42c7-a27e-01d79dd6a794', '12068c08-7a20-4a8d-bcef-49bd9e3a7b35'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Delete snapshot completed successfully. Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a0eb17db-2185-4b87-89d3-ef766b7b20cf tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-ea390285-9eb4-449a-aa3b-65da0b463c02-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:47 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:47 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info is being set with open permissions: ugo+rw Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:47 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info Jul 21 17:25:47 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:47 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.info" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-65047c55-8f17-496f-b24c-ad95ca3439cb req-27f599db-fbd1-48da-9eab-773478c9e5f4 tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.886s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-65047c55-8f17-496f-b24c-ad95ca3439cb req-27f599db-fbd1-48da-9eab-773478c9e5f4 tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e25a777f-0432-407b-ab59-9c218ca6b634 tempest-VolumesDeleteCascade-985560813 None] Create snapshot completed successfully Jul 21 17:25:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-65047c55-8f17-496f-b24c-ad95ca3439cb req-27f599db-fbd1-48da-9eab-773478c9e5f4 tempest-TestMinimumBasicScenario-951623835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-3b5583a6-0963-4612-94ec-5ece86b944e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b1ad865-547f-4800-aa5b-0c06566ba85d', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:25:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-65047c55-8f17-496f-b24c-ad95ca3439cb req-27f599db-fbd1-48da-9eab-773478c9e5f4 tempest-TestMinimumBasicScenario-951623835 None] attachment_update completed successfully. Jul 21 17:25:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-e0c81655-be65-4714-ad7a-f13949c173ae-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-e0c81655-be65-4714-ad7a-f13949c173ae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-e0c81655-be65-4714-ad7a-f13949c173ae" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-e0c81655-be65-4714-ad7a-f13949c173ae" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cb2450-cd33-47df-bb0e-a018cec88bb7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:48 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:48 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:49 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.547s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:49 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae Jul 21 17:25:49 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Flow 'volume_create_manager' (40c15407-3886-432c-b678-bfd4c856a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e911e1fc-8ce7-4623-a503-975e43708050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e911e1fc-8ce7-4623-a503-975e43708050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-326409483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28de3897-b30f-4501-88ce-fbee2eea72c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa0b0ea4d7f4c32a0ec043c23fc9cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cc126a2-e1c4-4402-b97f-0d140bb80798,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:49Z,use_quota=True,user_id='1d7432faca5e4ae78315f807ce55ffe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35679c3-8efd-4e3a-b674-8aa76a9cce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35679c3-8efd-4e3a-b674-8aa76a9cce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a6e00a-f16d-4c83-a350-09e6d5cb5b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a6e00a-f16d-4c83-a350-09e6d5cb5b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28de3897-b30f-4501-88ce-fbee2eea72c3', 'volume_name': 'volume-28de3897-b30f-4501-88ce-fbee2eea72c3', 'volume_size': 1, 'snapshot_id': '2cc126a2-e1c4-4402-b97f-0d140bb80798'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a99d27b-f682-4d83-a543-803db481a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a99d27b-f682-4d83-a543-803db481a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b3bdd6-6c04-4a33-b806-7f5ca95cd347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:49 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Volume 28de3897-b30f-4501-88ce-fbee2eea72c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28de3897-b30f-4501-88ce-fbee2eea72c3', 'volume_size': 1, 'snapshot_id': '2cc126a2-e1c4-4402-b97f-0d140bb80798'} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-2cc126a2-e1c4-4402-b97f-0d140bb80798-28de3897-b30f-4501-88ce-fbee2eea72c3" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-2cc126a2-e1c4-4402-b97f-0d140bb80798-28de3897-b30f-4501-88ce-fbee2eea72c3" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Creating volume 28de3897-b30f-4501-88ce-fbee2eea72c3 from snapshot 2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-28de3897-b30f-4501-88ce-fbee2eea72c3" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-28de3897-b30f-4501-88ce-fbee2eea72c3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] snapshot: 2cc126a2-e1c4-4402-b97f-0d140bb80798, volume: 28de3897-b30f-4501-88ce-fbee2eea72c3, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:25:49 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e0c81655-be65-4714-ad7a-f13949c173ae" returned: 0 in 0.487s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[64708cb0-d88c-475b-98e1-6237181e821c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-e0c81655-be65-4714-ad7a-f13949c173ae" released by "delete_volume" :: held 1.130s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['ea68448a-5a22-4160-acfd-ec9911388bdd', '54660bc8-f95c-48ef-a420-ec30d16e736b', '1cdf9ec4-50a9-4e39-833f-b0a17a42d511', '10201808-af66-47fb-9d1c-ec0ed2e072fa'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:49 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:25:49 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:49 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 Jul 21 17:25:49 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:50 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.486s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:25:50 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Deleted volume successfully. Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f3f1635a-5099-4e34-98b3-151adda6e09c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-e0c81655-be65-4714-ad7a-f13949c173ae-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:50 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798" returned: 0 in 0.805s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbdd54-2111-45ca-8261-041be7ec805c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:50 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:25:50 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:51 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.657s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:51 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 Jul 21 17:25:51 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (ba66e132-e540-41e9-ad71-70d9521d5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d8b845-d8de-407a-bbb0-96c43144794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d8b845-d8de-407a-bbb0-96c43144794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1176481962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62782bdc-b705-4fab-b0ef-9e8ebacf671c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:52Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5690ef98-18c4-4d4d-b835-a1b83a25b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5690ef98-18c4-4d4d-b835-a1b83a25b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833a11e7-3675-4e86-ad22-1e335548085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833a11e7-3675-4e86-ad22-1e335548085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62782bdc-b705-4fab-b0ef-9e8ebacf671c', 'volume_name': 'volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82be170a-0b00-4b1a-aee0-eff5303a3c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82be170a-0b00-4b1a-aee0-eff5303a3c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6e4375-59b0-4089-875d-35e82beab1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:51 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Volume 62782bdc-b705-4fab-b0ef-9e8ebacf671c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c', 'volume_size': 1} Jul 21 17:25:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:57 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3" returned: 0 in 5.940s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[564659ca-8929-4835-9c74-08f0b8d67e05]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:57 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:25:57 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:57 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.586s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:25:57 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Converted 1024.00 MB image at 172.36 MB/s Jul 21 17:25:57 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 is being set with open permissions: ugo+rw Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:57 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 Jul 21 17:25:57 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:57 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3" returned: 0 in 0.247s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-28de3897-b30f-4501-88ce-fbee2eea72c3" released by "_copy_volume_from_snapshot" :: held 8.365s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-2cc126a2-e1c4-4402-b97f-0d140bb80798-28de3897-b30f-4501-88ce-fbee2eea72c3" released by "_create_volume_from_snapshot" :: held 8.420s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.450s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.019s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1176481962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62782bdc-b705-4fab-b0ef-9e8ebacf671c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:25:52Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Creating volume 62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:25:57 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:57 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c 1073741824 Jul 21 17:25:57 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b3bdd6-6c04-4a33-b806-7f5ca95cd347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28de3897-b30f-4501-88ce-fbee2eea72c3', 'volume_size': 1, 'snapshot_id': '2cc126a2-e1c4-4402-b97f-0d140bb80798'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322eff95-161a-4894-b578-91abe61fb8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Volume volume-28de3897-b30f-4501-88ce-fbee2eea72c3 (28de3897-b30f-4501-88ce-fbee2eea72c3): created successfully Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322eff95-161a-4894-b578-91abe61fb8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Flow 'volume_create_manager' (40c15407-3886-432c-b678-bfd4c856a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1abbe551-07b1-442d-8c25-16faf24317f5 tempest-VolumesDeleteCascade-985560813 None] Created volume successfully. Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-947ad613-9c96-4d0b-92c5-f9a17a62fa32-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-947ad613-9c96-4d0b-92c5-f9a17a62fa32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Performing cascade delete. {{(pid=87591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-2cc126a2-e1c4-4402-b97f-0d140bb80798-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-2cc126a2-e1c4-4402-b97f-0d140bb80798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-947ad613-9c96-4d0b-92c5-f9a17a62fa32" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:58 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c 1073741824" returned: 0 in 0.565s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-947ad613-9c96-4d0b-92c5-f9a17a62fa32" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-2cc126a2-e1c4-4402-b97f-0d140bb80798" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-2cc126a2-e1c4-4402-b97f-0d140bb80798" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Deleting offline snapshot 2cc126a2-e1c4-4402-b97f-0d140bb80798 of volume 947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] snapshot_file for this snap is: volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c338fc77-c982-45a3-83c9-e2befd68bf75]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:58 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:25:58 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:58 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 Jul 21 17:25:58 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:58 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.296s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6e4375-59b0-4089-875d-35e82beab1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd53c63-4fa5-4459-9510-8d9910632c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:25:58 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Volume volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c (62782bdc-b705-4fab-b0ef-9e8ebacf671c): created successfully Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd53c63-4fa5-4459-9510-8d9910632c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (ba66e132-e540-41e9-ad71-70d9521d5056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:25:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-01908f38-7ccc-4f0b-bfe3-b3a6510d3c2c tempest-VolumesSnapshotTestJSON-1326394460 None] Created volume successfully. Jul 21 17:25:58 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798" returned: 0 in 0.407s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbded323-29cc-4d6d-a487-8fb9d0b4f71a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:59 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:25:59 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:59 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.363s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:59 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 Jul 21 17:25:59 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:59 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:59 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798 Jul 21 17:25:59 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Creating offline snapshot 52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 of volume 62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eccd31e-7bb9-4d2f-a642-d24e70014747]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:25:59 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:25:59 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:25:59 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 21 17:25:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32.2cc126a2-e1c4-4402-b97f-0d140bb80798" returned: 0 in 0.275s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-2cc126a2-e1c4-4402-b97f-0d140bb80798" released by "_delete_snapshot" :: held 1.521s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-947ad613-9c96-4d0b-92c5-f9a17a62fa32" released by "delete_snapshot" :: held 1.565s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Created reservations ['ced44769-8d3b-450e-a558-207322a53fb9', 'f44ed5d6-9c15-4918-b202-d34f8d542d63', 'db45e75c-9701-47b0-8bd4-a784ca4b95d3', '724b53a7-9775-4be3-add6-f5410a419fc8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Delete snapshot completed successfully. Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-2cc126a2-e1c4-4402-b97f-0d140bb80798-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Snapshots deleted, issuing volume delete {{(pid=87591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-947ad613-9c96-4d0b-92c5-f9a17a62fa32" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-947ad613-9c96-4d0b-92c5-f9a17a62fa32" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:00 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.415s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb65d4-8e95-4f12-89a6-e7c6f963af1f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:00 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 1G Jul 21 17:26:00 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:00 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:26:00 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:00 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:00 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32 Jul 21 17:26:00 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:00 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 1G" returned: 0 in 0.498s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:00 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 Jul 21 17:26:00 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:00 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-947ad613-9c96-4d0b-92c5-f9a17a62fa32" returned: 0 in 0.275s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-947ad613-9c96-4d0b-92c5-f9a17a62fa32" released by "delete_volume" :: held 0.798s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Created reservations ['61f1a508-8902-4fc4-bda9-36566c1542c6', 'c09383fa-8a94-4240-a58f-2b802af22305', 'fa4dcf3d-b2c3-4241-97f4-d25ed4039125', '8c65e06b-dc9b-40c1-9eb8-e4ba5e9d94fe'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:01 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" returned: 0 in 0.332s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:01 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 is being set with open permissions: ugo+rw Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:01 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 Jul 21 17:26:01 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:01 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:01 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:01 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" returned: 0 in 0.251s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:01 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info Jul 21 17:26:01 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:01 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.257s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Deleted volume successfully. Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82218c15-f743-4091-94bd-9ff7f8fa12a7 tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-947ad613-9c96-4d0b-92c5-f9a17a62fa32-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:01 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info" returned: 0 in 0.259s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:01 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info is being set with open permissions: ugo+rw Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:01 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info Jul 21 17:26:01 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-28de3897-b30f-4501-88ce-fbee2eea72c3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-28de3897-b30f-4501-88ce-fbee2eea72c3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "cinder-quobyte-28de3897-b30f-4501-88ce-fbee2eea72c3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:01 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.info" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-28de3897-b30f-4501-88ce-fbee2eea72c3" acquired by "delete_volume" :: waited 0.043s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cc2c78-e136-4266-9aff-d7e0fa1aa5ae]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0997fcd2-6241-4b5d-8117-d59caa636bab tempest-VolumesSnapshotTestJSON-1326394460 None] Create snapshot completed successfully Jul 21 17:26:02 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 Jul 21 17:26:02 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:02 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3" returned: 0 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:02 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3 Jul 21 17:26:02 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:02 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-28de3897-b30f-4501-88ce-fbee2eea72c3" returned: 0 in 0.251s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-quobyte-28de3897-b30f-4501-88ce-fbee2eea72c3" released by "delete_volume" :: held 0.684s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Created reservations ['da2d6c23-93b5-428e-8563-69d3cdfd3457', 'a2c062b2-378c-476e-9e59-3ac279f7cb1e', 'f4cae9c6-4c96-4945-8403-0e9fa28bba67', 'eb7b8342-c8de-43a8-9728-dc85b807be4f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:02 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:02 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:03 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Deleted volume successfully. Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-49c84b6e-47d1-4a7c-9bd5-245d0c817b1e tempest-VolumesDeleteCascade-985560813 None] Lock "cinder-28de3897-b30f-4501-88ce-fbee2eea72c3-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (52cf0e56-d47a-451d-bfdc-c02740b8d2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef8263-e62b-48fa-9e22-8cfacff8ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef8263-e62b-48fa-9e22-8cfacff8ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1197573559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b030d808-23aa-4a9f-9e19-140c40524014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd413c4abc44caf866671b9889e1522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:03Z,use_quota=True,user_id='cd401f609d944ddabb2a0622039ca0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c1c0d3-cd24-49fd-90cb-eab40bf12f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c1c0d3-cd24-49fd-90cb-eab40bf12f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f06580-a171-48ab-8176-75d7ba2256c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f06580-a171-48ab-8176-75d7ba2256c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b030d808-23aa-4a9f-9e19-140c40524014', 'volume_name': 'volume-b030d808-23aa-4a9f-9e19-140c40524014', 'volume_size': 1, 'snapshot_id': '52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ee427a-42f1-455f-b2ae-95cf58ba3a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ee427a-42f1-455f-b2ae-95cf58ba3a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2439a6f8-cf81-45e7-a77f-bc51ea969120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume b030d808-23aa-4a9f-9e19-140c40524014: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b030d808-23aa-4a9f-9e19-140c40524014', 'volume_size': 1, 'snapshot_id': '52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233'} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233-b030d808-23aa-4a9f-9e19-140c40524014" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233-b030d808-23aa-4a9f-9e19-140c40524014" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Creating volume b030d808-23aa-4a9f-9e19-140c40524014 from snapshot 52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-b030d808-23aa-4a9f-9e19-140c40524014" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-b030d808-23aa-4a9f-9e19-140c40524014" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] snapshot: 52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233, volume: b030d808-23aa-4a9f-9e19-140c40524014, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ca7d6-0cc8-45f5-a193-358a6ac2f892]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:04 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 Jul 21 17:26:04 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:04 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a2864-ab38-4ad5-9b0b-0d6e07d6e440]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:04 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:26:04 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:04 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.480s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:26:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:04 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 Jul 21 17:26:04 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-1252dda7-b655-4e45-b265-b6620e7e56a7 tempest-TestShelveInstance-810845451 None] Terminate volume connection completed successfully. Jul 21 17:26:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-1252dda7-b655-4e45-b265-b6620e7e56a7 tempest-TestShelveInstance-810845451 None] Deleting attachment af16d7e9-ff7e-4c63-85b5-fce81cbae6a2. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:26:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Acquiring lock "cinder-19c6ea17-b837-4583-beb2-8a4d06444dc9-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Lock "cinder-19c6ea17-b837-4583-beb2-8a4d06444dc9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Acquiring lock "cinder-quobyte-19c6ea17-b837-4583-beb2-8a4d06444dc9" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Lock "cinder-quobyte-19c6ea17-b837-4583-beb2-8a4d06444dc9" acquired by "delete_volume" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b9e50a-1051-40ad-8d12-7a8c53b71a07]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:10 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 Jul 21 17:26:10 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:10 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9" returned: 0 in 1.197s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:10 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9 Jul 21 17:26:10 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:11 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014" returned: 0 in 6.701s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:11 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-19c6ea17-b837-4583-beb2-8a4d06444dc9" returned: 0 in 0.713s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4cec8d-6790-49e7-8374-5d3bce86f80f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Lock "cinder-quobyte-19c6ea17-b837-4583-beb2-8a4d06444dc9" released by "delete_volume" :: held 2.036s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG cinder.quota [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Created reservations ['09b4dd15-9961-48d7-ba2d-dee5b72a34b8', 'f27904bd-1ad8-4da7-acb2-35aca5b324b5', '72bc9fad-1077-483b-a8c2-a2c1ccf426d7', '120d534f-0e58-4325-ac90-a17fc583423f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:11 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:26:11 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:11 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:11 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:12 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.manager [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Deleted volume successfully. Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=120,cinder:UPDATE=117,cinder:INSERT=33,cinder:DELETE=14 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [req-5c3e0eba-04bf-4eaf-98dd-e5d52f58154e req-598dca45-956d-4b42-bca5-f8fcc7fcf0c7 tempest-TestShelveInstance-810845451 None] Lock "cinder-19c6ea17-b837-4583-beb2-8a4d06444dc9-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:12 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.965s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:26:12 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Converted 1024.00 MB image at 152.78 MB/s Jul 21 17:26:12 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 is being set with open permissions: ugo+rw Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:12 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 Jul 21 17:26:12 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:12 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-b030d808-23aa-4a9f-9e19-140c40524014" released by "_copy_volume_from_snapshot" :: held 9.137s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233-b030d808-23aa-4a9f-9e19-140c40524014" released by "_create_volume_from_snapshot" :: held 9.200s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.245s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=116,cinder:UPDATE=104,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2439a6f8-cf81-45e7-a77f-bc51ea969120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b030d808-23aa-4a9f-9e19-140c40524014', 'volume_size': 1, 'snapshot_id': '52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376337f9-eda5-4afa-8c5a-fe91bb3e127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Volume volume-b030d808-23aa-4a9f-9e19-140c40524014 (b030d808-23aa-4a9f-9e19-140c40524014): created successfully Jul 21 17:26:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376337f9-eda5-4afa-8c5a-fe91bb3e127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Flow 'volume_create_manager' (52cf0e56-d47a-451d-bfdc-c02740b8d2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8d4297f6-f9e9-4e9f-ab0c-c4bbdcad47c3 tempest-VolumesSnapshotTestJSON-1326394460 None] Created volume successfully. Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Flow 'volume_create_manager' (9d15eb23-e48c-4663-840e-8f2833ed0f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a43221a-ef46-47f5-a610-0a4491aaa221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a43221a-ef46-47f5-a610-0a4491aaa221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-677025841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4001e1c2-63d7-42e4-af06-3d3f76a28d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb97289682f43daaf9aabb824ad4dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:13Z,use_quota=True,user_id='bcee087887514ffcb7175defa12de525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3e8b87-71f7-4378-957a-eeccc72ca6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3e8b87-71f7-4378-957a-eeccc72ca6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181187c4-0953-4f4a-963b-cca6f420ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181187c4-0953-4f4a-963b-cca6f420ff70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4001e1c2-63d7-42e4-af06-3d3f76a28d37', 'volume_name': 'volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33571f-8bdc-417c-8f89-d9a0e513bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33571f-8bdc-417c-8f89-d9a0e513bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683f05b4-68f0-428c-b1cb-168efb096f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Volume 4001e1c2-63d7-42e4-af06-3d3f76a28d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37', 'volume_size': 1} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-677025841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4001e1c2-63d7-42e4-af06-3d3f76a28d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb97289682f43daaf9aabb824ad4dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:13Z,use_quota=True,user_id='bcee087887514ffcb7175defa12de525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Creating volume 4001e1c2-63d7-42e4-af06-3d3f76a28d37 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:13 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:13 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 1073741824 Jul 21 17:26:13 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-b030d808-23aa-4a9f-9e19-140c40524014-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-b030d808-23aa-4a9f-9e19-140c40524014-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-b030d808-23aa-4a9f-9e19-140c40524014" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-b030d808-23aa-4a9f-9e19-140c40524014" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:14 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 1073741824" returned: 0 in 0.683s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d6bea-dea1-4ab0-a62c-055bc87e6790]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:14 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 Jul 21 17:26:14 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:14 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 Jul 21 17:26:14 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:14 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37" returned: 0 in 0.350s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683f05b4-68f0-428c-b1cb-168efb096f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ac198e-b889-4b08-90bb-188d383d3b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Volume volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 (4001e1c2-63d7-42e4-af06-3d3f76a28d37): created successfully Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ac198e-b889-4b08-90bb-188d383d3b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Flow 'volume_create_manager' (9d15eb23-e48c-4663-840e-8f2833ed0f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:14 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014" returned: 0 in 0.475s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6e5e8527-e95c-4f9c-a0d3-f070b95086c5 tempest-VolumesTransfersTest-926483647 None] Created volume successfully. Jul 21 17:26:14 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014 Jul 21 17:26:14 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:14 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b030d808-23aa-4a9f-9e19-140c40524014" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-b030d808-23aa-4a9f-9e19-140c40524014" released by "delete_volume" :: held 0.854s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:14 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['dee32baf-9f9c-499a-8e06-57be56ea5046', '9119fd5e-a13b-4382-98dd-3bbe1c49688f', 'ce2eed34-85ca-425a-9830-afa26cc84e6a', '8a3a40f5-287c-411a-a644-d078ff7e22b2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:15 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:15 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-62782bdc-b705-4fab-b0ef-9e8ebacf671c" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-62782bdc-b705-4fab-b0ef-9e8ebacf671c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Deleting offline snapshot 52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 of volume 62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:26:15 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] snapshot_file for this snap is: volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.385s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Deleted volume successfully. Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c463a3b-7637-43a4-9bf6-4196ae8edb9a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-62dd5ea9-1530-4e7e-afef-ca5ea0e8866f tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-b030d808-23aa-4a9f-9e19-140c40524014-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:15 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 Jul 21 17:26:15 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:15 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" returned: 0 in 0.496s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f635f75-c3da-4796-98b4-6106e05848a7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:16 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:26:16 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1fbd7a83-a194-4255-a43a-0d0cc070eb8b tempest-VolumesTransfersTest-1501657730 None] Transfer volume completed successfully. Jul 21 17:26:16 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.591s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:16 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 Jul 21 17:26:16 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Acquiring lock "cinder-4001e1c2-63d7-42e4-af06-3d3f76a28d37-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-4001e1c2-63d7-42e4-af06-3d3f76a28d37-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Acquiring lock "cinder-quobyte-4001e1c2-63d7-42e4-af06-3d3f76a28d37" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-quobyte-4001e1c2-63d7-42e4-af06-3d3f76a28d37" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c6ae8-e5a2-4a67-b7ab-825018ae948e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:17 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:17 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233 Jul 21 17:26:17 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:17 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 Jul 21 17:26:17 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:17 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c.52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233" released by "_delete_snapshot" :: held 2.139s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-62782bdc-b705-4fab-b0ef-9e8ebacf671c" released by "delete_snapshot" :: held 2.182s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:17 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37" returned: 0 in 0.503s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:17 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37 Jul 21 17:26:17 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['7e7a72f0-8b13-47af-bd28-d04df2b9cd06', '290685cc-8536-439f-a1e1-573f4273f13e', '86510334-bd54-465b-9472-f2c541160482', '07636d97-4170-4f1f-a1e2-160dd7cacb59'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Delete snapshot completed successfully. Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98a64d31-9343-4f3c-a49e-73d5cb07290c tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-52aa8c3b-7720-4c3c-8d9c-9fd0ff8a9233-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:17 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4001e1c2-63d7-42e4-af06-3d3f76a28d37" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-quobyte-4001e1c2-63d7-42e4-af06-3d3f76a28d37" released by "delete_volume" :: held 0.920s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:17 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Created reservations ['eeb207f8-d3ab-4f0c-b5a7-68374b6bdb47', '0e303463-e83c-4b81-9ddb-8efb4a509e46', '8e6c97db-3a44-48f3-8eaa-2dbb16f2fafc', '63874208-a659-401e-85d9-f404ce0cc1b2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:18 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:18 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:18 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Deleted volume successfully. Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e1a61a5-b706-44c2-975d-49be9864f983 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-4001e1c2-63d7-42e4-af06-3d3f76a28d37-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-62782bdc-b705-4fab-b0ef-9e8ebacf671c-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-62782bdc-b705-4fab-b0ef-9e8ebacf671c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-62782bdc-b705-4fab-b0ef-9e8ebacf671c" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-62782bdc-b705-4fab-b0ef-9e8ebacf671c" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf553a-3ae2-485f-af88-96f71fde30db]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Flow 'volume_create_manager' (dca46dff-09a2-481b-bfa7-cbc95b02dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1308a7f-f42f-424b-8c17-07f80e47e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:19 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1308a7f-f42f-424b-8c17-07f80e47e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-917107701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8991cfc5-edcb-46b5-96d0-dd2989acbf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb97289682f43daaf9aabb824ad4dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:19Z,use_quota=True,user_id='bcee087887514ffcb7175defa12de525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:19 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551ca86d-0fe0-4ef8-8d76-23bf7f00ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551ca86d-0fe0-4ef8-8d76-23bf7f00ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2119c2c-98bf-4ca4-af1b-ae48e18c15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2119c2c-98bf-4ca4-af1b-ae48e18c15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8991cfc5-edcb-46b5-96d0-dd2989acbf36', 'volume_name': 'volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf340fc-cc25-4e5c-92a0-ec1bc350e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf340fc-cc25-4e5c-92a0-ec1bc350e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09507794-d972-4d1f-8317-2ab54434fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Volume 8991cfc5-edcb-46b5-96d0-dd2989acbf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36', 'volume_size': 1} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-917107701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8991cfc5-edcb-46b5-96d0-dd2989acbf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb97289682f43daaf9aabb824ad4dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:19Z,use_quota=True,user_id='bcee087887514ffcb7175defa12de525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Creating volume 8991cfc5-edcb-46b5-96d0-dd2989acbf36 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:19 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 1073741824 Jul 21 17:26:19 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:19 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.482s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:19 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c Jul 21 17:26:19 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:19 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-62782bdc-b705-4fab-b0ef-9e8ebacf671c" returned: 0 in 0.356s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:19 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 1073741824" returned: 0 in 0.638s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-62782bdc-b705-4fab-b0ef-9e8ebacf671c" released by "delete_volume" :: held 0.918s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:19 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 Jul 21 17:26:19 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['0878377b-9228-48d1-b4da-ddf5a0227d92', 'dd336106-fc60-4838-b755-f76a19a64d5e', '98f446d8-255b-4493-a802-d86b93d97c92', '8b03c31a-479e-4487-879a-f5ee3133c950'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:20 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:20 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:20 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09507794-d972-4d1f-8317-2ab54434fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84f2036-ef82-486e-b646-ff61b9d25474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Volume volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 (8991cfc5-edcb-46b5-96d0-dd2989acbf36): created successfully Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84f2036-ef82-486e-b646-ff61b9d25474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Flow 'volume_create_manager' (dca46dff-09a2-481b-bfa7-cbc95b02dedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-de6b8140-c0f2-489a-b649-0aa059d204c1 tempest-VolumesTransfersTest-926483647 None] Created volume successfully. Jul 21 17:26:20 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Deleted volume successfully. Jul 21 17:26:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6fca28f7-046c-43dc-ba1c-8cd0baa4036b tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-62782bdc-b705-4fab-b0ef-9e8ebacf671c-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-36027d65-e9b1-45c2-9f7b-13d3936a9594-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-36027d65-e9b1-45c2-9f7b-13d3936a9594-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "cinder-quobyte-36027d65-e9b1-45c2-9f7b-13d3936a9594" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-36027d65-e9b1-45c2-9f7b-13d3936a9594" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[976a7db3-72d2-42b1-94b8-f215629971c7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:21 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 Jul 21 17:26:21 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Acquiring lock "cinder-8991cfc5-edcb-46b5-96d0-dd2989acbf36-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-8991cfc5-edcb-46b5-96d0-dd2989acbf36-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Acquiring lock "cinder-quobyte-8991cfc5-edcb-46b5-96d0-dd2989acbf36" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-quobyte-8991cfc5-edcb-46b5-96d0-dd2989acbf36" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430c750-7e98-401e-a673-0455ef3bf024]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:21 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594" returned: 0 in 0.673s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:21 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594 Jul 21 17:26:21 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:21 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 Jul 21 17:26:21 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:22 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-36027d65-e9b1-45c2-9f7b-13d3936a9594" returned: 0 in 0.297s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-quobyte-36027d65-e9b1-45c2-9f7b-13d3936a9594" released by "delete_volume" :: held 1.077s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Created reservations ['3bcb32ca-a275-4628-9ec1-83d26ba02e24', '07ab4515-e6c6-4166-8d1d-63862759184c', 'd41d5957-1701-4af3-9227-336e5c1eb022', 'fd64192a-258f-406f-96c9-41e5576b31b0'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:22 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36" returned: 0 in 0.538s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:22 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36 Jul 21 17:26:22 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:22 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:22 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:22 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8991cfc5-edcb-46b5-96d0-dd2989acbf36" returned: 0 in 0.377s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-quobyte-8991cfc5-edcb-46b5-96d0-dd2989acbf36" released by "delete_volume" :: held 0.985s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:22 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.391s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Created reservations ['b439ec01-1628-413a-900a-20ff039ad37a', 'b6fadc83-97f8-4dfa-87ef-bb5689d7e369', '2f0be9d4-6a27-4051-915e-892ed907761a', '235f9d06-3d3f-4092-935f-62d3d850310c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Deleted volume successfully. Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5b4d655a-7984-4518-9969-47a5dc728e35 tempest-VolumesSnapshotTestJSON-1326394460 None] Lock "cinder-36027d65-e9b1-45c2-9f7b-13d3936a9594-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:23 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:23 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:23 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.275s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:23 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Deleted volume successfully. Jul 21 17:26:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dd156cf4-3f91-40b2-a884-6f9bbd6c4378 tempest-VolumesTransfersTest-860379394 None] Lock "cinder-8991cfc5-edcb-46b5-96d0-dd2989acbf36-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (8dabe6cd-9ec7-4c60-9003-1a3eab6af93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7441e1-8579-41f9-bd32-eb5d642d0b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7441e1-8579-41f9-bd32-eb5d642d0b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573821746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239cd6af-ea58-4100-b76d-b1bf11111fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:27Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc80d0-515c-44fb-b761-ce1f2ba7c40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc80d0-515c-44fb-b761-ce1f2ba7c40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d654f54b-95b7-4869-8109-c6f671e3414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d654f54b-95b7-4869-8109-c6f671e3414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239cd6af-ea58-4100-b76d-b1bf11111fd1', 'volume_name': 'volume-239cd6af-ea58-4100-b76d-b1bf11111fd1', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e68c41-d33e-452d-93a2-249966d6120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e68c41-d33e-452d-93a2-249966d6120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29de817e-98a0-4370-b420-fe827df6e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume 239cd6af-ea58-4100-b76d-b1bf11111fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239cd6af-ea58-4100-b76d-b1bf11111fd1', 'volume_size': 1} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573821746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239cd6af-ea58-4100-b76d-b1bf11111fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:27Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating volume 239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:27 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:27 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 1073741824 Jul 21 17:26:27 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:28 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 1073741824" returned: 0 in 0.560s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:28 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 Jul 21 17:26:28 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:28 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1" returned: 0 in 0.297s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29de817e-98a0-4370-b420-fe827df6e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239cd6af-ea58-4100-b76d-b1bf11111fd1', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac660559-493f-43ab-8cba-b06bcd9bcc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 (239cd6af-ea58-4100-b76d-b1bf11111fd1): created successfully Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac660559-493f-43ab-8cba-b06bcd9bcc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (8dabe6cd-9ec7-4c60-9003-1a3eab6af93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2891e462-a840-41e9-8398-8a12c41b42ce tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created volume successfully. Jul 21 17:26:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating offline snapshot cd4dc791-551f-4dd1-9190-dae57bace55d of volume 239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:26:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b4119e-8855-4a1c-8901-e4b1e68d4775]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:29 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 Jul 21 17:26:29 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:30 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1" returned: 0 in 0.420s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:30 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d 1G Jul 21 17:26:30 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:30 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d 1G" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:30 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d Jul 21 17:26:30 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:30 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d" returned: 0 in 0.388s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:30 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d is being set with open permissions: ugo+rw Jul 21 17:26:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:30 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d Jul 21 17:26:30 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Flow 'volume_create_manager' (13692f9f-46b4-4866-abe0-b26afd558c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8d300e-2284-4a26-9c35-82efc0a58532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8d300e-2284-4a26-9c35-82efc0a58532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-390471480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd4254-eaeb-46e3-a627-3a8073caae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053e4a9ef9954c9b91097ad8c38057d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:31Z,use_quota=True,user_id='511c35f6653440d9b06f00dfc9891715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8544b3-228f-4d54-a916-de87e7d57451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8544b3-228f-4d54-a916-de87e7d57451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4940eed0-7de6-4300-9247-4eec8417cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4940eed0-7de6-4300-9247-4eec8417cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fd4254-eaeb-46e3-a627-3a8073caae9c', 'volume_name': 'volume-54fd4254-eaeb-46e3-a627-3a8073caae9c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcebb285-0d26-4b77-b645-deb946e906fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcebb285-0d26-4b77-b645-deb946e906fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c055ef0-fe11-4807-b7d7-2457bcfe2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:31 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Volume 54fd4254-eaeb-46e3-a627-3a8073caae9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fd4254-eaeb-46e3-a627-3a8073caae9c', 'volume_size': 1} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:31 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:31 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info Jul 21 17:26:31 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:31 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:31 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info is being set with open permissions: ugo+rw Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:31 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info Jul 21 17:26:31 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:31 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.info" returned: 0 in 0.300s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-390471480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd4254-eaeb-46e3-a627-3a8073caae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053e4a9ef9954c9b91097ad8c38057d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:31Z,use_quota=True,user_id='511c35f6653440d9b06f00dfc9891715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Creating volume 54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:32 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:32 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c 1073741824 Jul 21 17:26:32 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-85473329-b611-4343-81c5-c0a2c62fe81f tempest-CreateVolumesFromSnapshotTest-1149575390 None] Create snapshot completed successfully Jul 21 17:26:32 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c 1073741824" returned: 0 in 0.507s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:32 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:32 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:32 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.245s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c055ef0-fe11-4807-b7d7-2457bcfe2039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fd4254-eaeb-46e3-a627-3a8073caae9c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162c1f84-adc1-410e-abaf-5ce2aefb5626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:32 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Volume volume-54fd4254-eaeb-46e3-a627-3a8073caae9c (54fd4254-eaeb-46e3-a627-3a8073caae9c): created successfully Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162c1f84-adc1-410e-abaf-5ce2aefb5626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Flow 'volume_create_manager' (13692f9f-46b4-4866-abe0-b26afd558c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-24f57c72-a571-40ae-879e-f0404a80aa68 tempest-VolumesCloneTest-943488966 None] Created volume successfully. Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (e4cb84e2-97b9-4d34-a043-cbac33aa7e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f812870-841f-4801-b867-1aa1caab8bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f812870-841f-4801-b867-1aa1caab8bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-526128882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026173cf-b38d-4343-9ab6-7395a8ae267e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:33Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d98bc8e-a3ca-49ae-b5d6-89a9390b4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d98bc8e-a3ca-49ae-b5d6-89a9390b4213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ccd1c1-fff2-4886-9b5a-ab48614862ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ccd1c1-fff2-4886-9b5a-ab48614862ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026173cf-b38d-4343-9ab6-7395a8ae267e', 'volume_name': 'volume-026173cf-b38d-4343-9ab6-7395a8ae267e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360a7c7d-fc29-4c24-ad6f-73430afe532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360a7c7d-fc29-4c24-ad6f-73430afe532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5941b6-b0a9-4959-a25b-1a9b837835cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:33 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume 026173cf-b38d-4343-9ab6-7395a8ae267e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026173cf-b38d-4343-9ab6-7395a8ae267e', 'volume_size': 1} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-526128882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026173cf-b38d-4343-9ab6-7395a8ae267e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:33Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating volume 026173cf-b38d-4343-9ab6-7395a8ae267e {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:33 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:33 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e 1073741824 Jul 21 17:26:33 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:34 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e 1073741824" returned: 0 in 0.749s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:34 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e Jul 21 17:26:34 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (d4720d08-2010-483c-9591-73f11ec543c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40fa467-0313-4a75-bc23-67413b6a3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40fa467-0313-4a75-bc23-67413b6a3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188858627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a99058-e921-4cf0-bc43-b707e0cd670c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:34Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606e27c3-79a1-4fd0-83c0-a5bb05d5a8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606e27c3-79a1-4fd0-83c0-a5bb05d5a8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f223ede2-e007-4ae4-9bc0-a7e5ef6b52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f223ede2-e007-4ae4-9bc0-a7e5ef6b52af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a99058-e921-4cf0-bc43-b707e0cd670c', 'volume_name': 'volume-72a99058-e921-4cf0-bc43-b707e0cd670c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c31e32-64eb-4564-b416-c3a2f3bc694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c31e32-64eb-4564-b416-c3a2f3bc694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdadf39-743a-477f-a12a-fd903a5d2831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume 72a99058-e921-4cf0-bc43-b707e0cd670c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a99058-e921-4cf0-bc43-b707e0cd670c', 'volume_size': 1} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Flow 'volume_create_manager' (0df07334-8b00-43ff-8c81-f9815aa2a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cde517f-dc8e-4995-8357-698f76c96dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cde517f-dc8e-4995-8357-698f76c96dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1744308820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9b04f2-6382-40ca-96e7-ff6268917055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053e4a9ef9954c9b91097ad8c38057d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=54fd4254-eaeb-46e3-a627-3a8073caae9c,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:34Z,use_quota=True,user_id='511c35f6653440d9b06f00dfc9891715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7705d5-37f1-4d5f-8bc1-fd17701c4bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7705d5-37f1-4d5f-8bc1-fd17701c4bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d006c97d-6541-47d9-a4b7-04efe0f095c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:34 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (a0d3cb24-cacd-41b2-95ca-b8b89b7a58d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233a7a21-5fd6-4395-86d0-1c0b38d88c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d006c97d-6541-47d9-a4b7-04efe0f095c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ac9b04f2-6382-40ca-96e7-ff6268917055', 'volume_name': 'volume-ac9b04f2-6382-40ca-96e7-ff6268917055', 'volume_size': 2, 'source_volid': '54fd4254-eaeb-46e3-a627-3a8073caae9c', 'source_volstatus': 'available'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b710aa9-db1e-416d-8593-e2750540be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b710aa9-db1e-416d-8593-e2750540be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e144d218-4a63-4576-837c-99b638c78d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Volume ac9b04f2-6382-40ca-96e7-ff6268917055: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ac9b04f2-6382-40ca-96e7-ff6268917055', 'volume_size': 2, 'source_volid': '54fd4254-eaeb-46e3-a627-3a8073caae9c', 'source_volstatus': 'available'} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233a7a21-5fd6-4395-86d0-1c0b38d88c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1538117517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c06d9be-589f-4506-be88-4b0932c33cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:35Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81e3d40-eeca-495f-9631-722fcf8e52be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81e3d40-eeca-495f-9631-722fcf8e52be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4df2d7-8e06-40d0-a029-ee325f5ed18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4df2d7-8e06-40d0-a029-ee325f5ed18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c06d9be-589f-4506-be88-4b0932c33cb0', 'volume_name': 'volume-4c06d9be-589f-4506-be88-4b0932c33cb0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af16f8a5-db77-44d6-aa96-fde3c201323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af16f8a5-db77-44d6-aa96-fde3c201323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cb14f4-f5bf-45b1-a1e4-2310d608a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume 4c06d9be-589f-4506-be88-4b0932c33cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c06d9be-589f-4506-be88-4b0932c33cb0', 'volume_size': 1} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e" returned: 0 in 0.707s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188858627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a99058-e921-4cf0-bc43-b707e0cd670c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:34Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating volume 72a99058-e921-4cf0-bc43-b707e0cd670c {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:35 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:35 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c 1073741824 Jul 21 17:26:35 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5941b6-b0a9-4959-a25b-1a9b837835cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026173cf-b38d-4343-9ab6-7395a8ae267e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5b02ca-37a7-441f-9ea8-27806f1a96dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume volume-026173cf-b38d-4343-9ab6-7395a8ae267e (026173cf-b38d-4343-9ab6-7395a8ae267e): created successfully Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5b02ca-37a7-441f-9ea8-27806f1a96dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (e4cb84e2-97b9-4d34-a043-cbac33aa7e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (45917484-e04d-477c-b263-129cb6642e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f5816c-b968-42f2-86ac-76731654096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-49f6992c-53f7-49a7-976d-ae09475bc0c3 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created volume successfully. Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f5816c-b968-42f2-86ac-76731654096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1723161992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a09624-7e94-4d91-b3e9-e1c13804e05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:35Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0199eef0-f1ce-45f5-be62-35c777c0d388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0199eef0-f1ce-45f5-be62-35c777c0d388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e88fa94-183c-42c1-97d3-07915750a174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e88fa94-183c-42c1-97d3-07915750a174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a09624-7e94-4d91-b3e9-e1c13804e05c', 'volume_name': 'volume-77a09624-7e94-4d91-b3e9-e1c13804e05c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c658d6d-bbfb-4599-a103-f856229a0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c658d6d-bbfb-4599-a103-f856229a0098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b3e90e-1749-419e-9723-18fdfb2d3a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume 77a09624-7e94-4d91-b3e9-e1c13804e05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a09624-7e94-4d91-b3e9-e1c13804e05c', 'volume_size': 1} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:35 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (636d482d-8f69-4378-a04c-247ff1819a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f44395-59b2-44c9-9cec-e4b58e7c9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c 1073741824" returned: 0 in 0.803s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f44395-59b2-44c9-9cec-e4b58e7c9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558572837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df758e96-b037-4851-8c7e-cabb3b7564c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:36Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420ab6a4-6952-43a8-8ef3-7cafdbdaec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420ab6a4-6952-43a8-8ef3-7cafdbdaec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1111558-77fe-471d-b9a1-78cd1f125c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1111558-77fe-471d-b9a1-78cd1f125c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df758e96-b037-4851-8c7e-cabb3b7564c0', 'volume_name': 'volume-df758e96-b037-4851-8c7e-cabb3b7564c0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6badead1-4cbd-427b-860d-2cd7c014c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6badead1-4cbd-427b-860d-2cd7c014c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a9d732-b757-461f-8ae4-c169e34c6151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume df758e96-b037-4851-8c7e-cabb3b7564c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df758e96-b037-4851-8c7e-cabb3b7564c0', 'volume_size': 1} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Flow 'volume_create_manager' (f78060d5-22db-4801-bd3f-09de157833da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6e2950-0cbf-4f2c-9774-05b31839f74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6e2950-0cbf-4f2c-9774-05b31839f74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fd8242-f41b-41c5-b1dd-006e4f2d8937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570891dc1d1b43ff9eb6f2632e890eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:36Z,use_quota=True,user_id='be031a59e74942a3930e065fa74fdaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a341bb88-eb7a-462b-a410-c01539232992),volume_type_id=a341bb88-eb7a-462b-a410-c01539232992)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2fc85a-6518-488f-ab10-9585146c4b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2fc85a-6518-488f-ab10-9585146c4b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c8966-64c8-4905-a903-d14bb062d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:36 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c Jul 21 17:26:36 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c8966-64c8-4905-a903-d14bb062d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95fd8242-f41b-41c5-b1dd-006e4f2d8937', 'volume_name': 'volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937', 'volume_size': 1, 'image_id': '4461c275-8133-4ae9-8de8-661755df0a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4461c275-8133-4ae9-8de8-661755df0a75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec7765fd8086af9928d73ecb7ef33f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '570891dc1d1b43ff9eb6f2632e890eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c62f0142e15711d77b10b4a68feaae6275b1d2f28851d9ddddf5cacda93feba34d86713ca14a6f6a1bc9e620ff2a096b376f1e880c74420c44b86cb8b7f00936', 'id': '4461c275-8133-4ae9-8de8-661755df0a75', 'created_at': datetime.datetime(2026, 7, 21, 15, 26, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 26, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4461c275-8133-4ae9-8de8-661755df0a75/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b196b7d-e746-44b2-9a0c-dd4fb10f47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b196b7d-e746-44b2-9a0c-dd4fb10f47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada5ae98-2a91-41b5-8e80-bc02047e1c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Volume 95fd8242-f41b-41c5-b1dd-006e4f2d8937: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937', 'volume_size': 1, 'image_id': '4461c275-8133-4ae9-8de8-661755df0a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4461c275-8133-4ae9-8de8-661755df0a75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec7765fd8086af9928d73ecb7ef33f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '570891dc1d1b43ff9eb6f2632e890eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c62f0142e15711d77b10b4a68feaae6275b1d2f28851d9ddddf5cacda93feba34d86713ca14a6f6a1bc9e620ff2a096b376f1e880c74420c44b86cb8b7f00936', 'id': '4461c275-8133-4ae9-8de8-661755df0a75', 'created_at': datetime.datetime(2026, 7, 21, 15, 26, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 26, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4461c275-8133-4ae9-8de8-661755df0a75/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Trying to clone 95fd8242-f41b-41c5-b1dd-006e4f2d8937 from image 4461c275-8133-4ae9-8de8-661755df0a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4461c275-8133-4ae9-8de8-661755df0a75', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c" returned: 0 in 0.327s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1538117517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c06d9be-589f-4506-be88-4b0932c33cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:35Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating volume 4c06d9be-589f-4506-be88-4b0932c33cb0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:36 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdadf39-743a-477f-a12a-fd903a5d2831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a99058-e921-4cf0-bc43-b707e0cd670c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc0aa6e-89c0-426f-a1ac-3567bd27dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:36 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 1073741824 Jul 21 17:26:36 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:36 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume volume-72a99058-e921-4cf0-bc43-b707e0cd670c (72a99058-e921-4cf0-bc43-b707e0cd670c): created successfully Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc0aa6e-89c0-426f-a1ac-3567bd27dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (d4720d08-2010-483c-9591-73f11ec543c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d1f44971-3a61-4e8c-aaa7-20d22a2b25e4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created volume successfully. Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:26:36 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Image download 0.00 MB at 0.00 MB/s Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1dbcf3-d400-4db3-80ee-4fe271b5d765]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:36 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD Jul 21 17:26:36 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:37 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:37 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 1073741824" returned: 0 in 0.671s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:37 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 Jul 21 17:26:37 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:37 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD Jul 21 17:26:37 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-c8d4e7da-ce04-430c-a0d3-d8259635bb71 req-f4a11075-3f4c-467d-87d8-80d50e8eed2a tempest-TestMinimumBasicScenario-951623835 None] Terminate volume connection completed successfully. Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-c8d4e7da-ce04-430c-a0d3-d8259635bb71 req-f4a11075-3f4c-467d-87d8-80d50e8eed2a tempest-TestMinimumBasicScenario-951623835 None] Deleting attachment 7b1ad865-547f-4800-aa5b-0c06566ba85d. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:26:37 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.289s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:37 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Cloning volume 54fd4254-eaeb-46e3-a627-3a8073caae9c to volume ac9b04f2-6382-40ca-96e7-ff6268917055 Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cb14f4-f5bf-45b1-a1e4-2310d608a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c06d9be-589f-4506-be88-4b0932c33cb0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:37 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b33c20-0bea-4b54-8a6c-438ebd0a1490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Temporary image 4461c275-8133-4ae9-8de8-661755df0a75 is fetched for user be031a59e74942a3930e065fa74fdaa5. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:26:37 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume volume-4c06d9be-589f-4506-be88-4b0932c33cb0 (4c06d9be-589f-4506-be88-4b0932c33cb0): created successfully Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b33c20-0bea-4b54-8a6c-438ebd0a1490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (a0d3cb24-cacd-41b2-95ca-b8b89b7a58d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Creating offline snapshot 7efd55eb-95dc-4780-b7af-cf4fb8a61afe of volume 54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:26:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9cb10db6-bc83-4624-aec1-3600c233bd44 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created volume successfully. Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ba8ad-e663-4e09-a2e2-33372cce7cb3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda7b405-5797-491d-8481-4c1196e19b18]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:37 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:37 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:37 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD Jul 21 17:26:37 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:38 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:38 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.449s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:38 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe 1G Jul 21 17:26:38 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:38 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD Jul 21 17:26:38 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Acquiring lock "cinder-3b5583a6-0963-4612-94ec-5ece86b944e3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Lock "cinder-3b5583a6-0963-4612-94ec-5ece86b944e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:38 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Acquiring lock "cinder-quobyte-3b5583a6-0963-4612-94ec-5ece86b944e3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Lock "cinder-quobyte-3b5583a6-0963-4612-94ec-5ece86b944e3" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[efffc310-8375-427f-851d-a18617ecfbd3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:38 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe 1G" returned: 0 in 0.496s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fd4254-eaeb-46e3-a627-3a8073caae9c -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:38 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 Jul 21 17:26:38 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:38 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fd4254-eaeb-46e3-a627-3a8073caae9c -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe Jul 21 17:26:38 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:38 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:38 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3 Jul 21 17:26:38 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:38 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fd4254-eaeb-46e3-a627-3a8073caae9c -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:38 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe is being set with open permissions: ugo+rw Jul 21 17:26:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:38 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe Jul 21 17:26:38 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:39 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3b5583a6-0963-4612-94ec-5ece86b944e3" returned: 0 in 0.266s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Lock "cinder-quobyte-3b5583a6-0963-4612-94ec-5ece86b944e3" released by "delete_volume" :: held 0.679s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:39 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe" returned: 0 in 0.259s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Created reservations ['8ac4ddb6-ad4f-413b-90c7-9a9af9cc49bb', 'f8194c7f-394e-4869-9530-a152ef3d55b7', '24d7377e-fc94-4768-9c28-bc0f7027cfc1', '9abada54-b391-45aa-82c9-e09c8d9e16e3'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:39 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info Jul 21 17:26:39 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:39 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:39 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:39 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info" returned: 0 in 0.281s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:39 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info is being set with open permissions: ugo+rw Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:39 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info Jul 21 17:26:39 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:39 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.271s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Deleted volume successfully. Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b7918c2e-efa0-43dc-a205-acb8351beb11 tempest-TestMinimumBasicScenario-951623835 None] Lock "cinder-3b5583a6-0963-4612-94ec-5ece86b944e3-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:39 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.info" returned: 0 in 0.323s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Acquiring lock "cinder-quobyte-ac9b04f2-6382-40ca-96e7-ff6268917055" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-ac9b04f2-6382-40ca-96e7-ff6268917055" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] snapshot: 7efd55eb-95dc-4780-b7af-cf4fb8a61afe, volume: ac9b04f2-6382-40ca-96e7-ff6268917055, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff93ae7-5a31-4f76-baa4-c3204859cf82]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:39 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe Jul 21 17:26:39 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:40 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe" returned: 0 in 0.519s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54fd4254-eaeb-46e3-a627-3a8073caae9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c105e707-2fdd-43a6-9a70-3e85517e7292]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:40 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:40 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:40 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.374s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:26:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:40 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 Jul 21 17:26:40 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:42 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:42 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:42 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.483s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:26:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:26:45 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055" returned: 0 in 4.849s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece10dd7-7a11-4532-b379-4663ec81f10b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:45 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:45 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:46 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.605s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:26:46 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Converted 1024.00 MB image at 211.15 MB/s Jul 21 17:26:46 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 is being set with open permissions: ugo+rw Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:46 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 Jul 21 17:26:46 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:46 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055" returned: 0 in 0.250s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-ac9b04f2-6382-40ca-96e7-ff6268917055" released by "_copy_volume_from_snapshot" :: held 6.687s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Acquiring lock "cinder-quobyte-7efd55eb-95dc-4780-b7af-cf4fb8a61afe" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-7efd55eb-95dc-4780-b7af-cf4fb8a61afe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Deleting offline snapshot 7efd55eb-95dc-4780-b7af-cf4fb8a61afe of volume 54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] snapshot_file for this snap is: volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971d5e6-11f9-43f8-8192-9cd084610f23]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:46 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe Jul 21 17:26:46 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:46 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe" returned: 0 in 0.393s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54fd4254-eaeb-46e3-a627-3a8073caae9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d5cf2f-e147-4389-9377-e3dabbfe6cb6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:47 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:47 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:47 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:47 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe Jul 21 17:26:47 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:47 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe" returned: 0 in 0.331s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:47 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe Jul 21 17:26:47 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:48 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c.7efd55eb-95dc-4780-b7af-cf4fb8a61afe" returned: 0 in 0.308s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-7efd55eb-95dc-4780-b7af-cf4fb8a61afe" released by "_delete_snapshot" :: held 1.578s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.644s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.712s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1723161992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a09624-7e94-4d91-b3e9-e1c13804e05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:35Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating volume 77a09624-7e94-4d91-b3e9-e1c13804e05c {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:48 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e144d218-4a63-4576-837c-99b638c78d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9b04f2-6382-40ca-96e7-ff6268917055', 'volume_size': 2, 'source_volid': '54fd4254-eaeb-46e3-a627-3a8073caae9c', 'source_volstatus': 'available'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:48 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c 1073741824 Jul 21 17:26:48 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab28d5-beda-4411-975c-c904ef763bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Volume volume-ac9b04f2-6382-40ca-96e7-ff6268917055 (ac9b04f2-6382-40ca-96e7-ff6268917055): created successfully Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab28d5-beda-4411-975c-c904ef763bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Flow 'volume_create_manager' (0df07334-8b00-43ff-8c81-f9815aa2a94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e1b90aa2-63e4-4664-bad2-f720622cc2b8 tempest-VolumesCloneTest-943488966 None] Created volume successfully. Jul 21 17:26:48 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c 1073741824" returned: 0 in 0.464s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:48 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c Jul 21 17:26:48 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:48 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.867s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558572837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df758e96-b037-4851-8c7e-cabb3b7564c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a65bf2b9f414fcd9e67f6aca32c85db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:36Z,use_quota=True,user_id='2830b6de0d9f468c8fa30562bf689de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Creating volume df758e96-b037-4851-8c7e-cabb3b7564c0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:48 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b3e90e-1749-419e-9723-18fdfb2d3a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a09624-7e94-4d91-b3e9-e1c13804e05c', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ba1181-c160-430b-87b3-f3632da1b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:48 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 1073741824 Jul 21 17:26:48 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume volume-77a09624-7e94-4d91-b3e9-e1c13804e05c (77a09624-7e94-4d91-b3e9-e1c13804e05c): created successfully Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ba1181-c160-430b-87b3-f3632da1b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (45917484-e04d-477c-b263-129cb6642e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a2a1e7f2-3a0b-40c7-9c20-0c339d643d36 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created volume successfully. Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Acquiring lock "cinder-ac9b04f2-6382-40ca-96e7-ff6268917055-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Lock "cinder-ac9b04f2-6382-40ca-96e7-ff6268917055-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Acquiring lock "cinder-quobyte-ac9b04f2-6382-40ca-96e7-ff6268917055" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-ac9b04f2-6382-40ca-96e7-ff6268917055" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b26a1f-f261-43aa-a7b2-d118dfb3b3f7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:49 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 1073741824" returned: 0 in 0.556s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:49 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 Jul 21 17:26:49 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:49 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 Jul 21 17:26:49 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:49 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.426s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fd8242-f41b-41c5-b1dd-006e4f2d8937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570891dc1d1b43ff9eb6f2632e890eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:36Z,use_quota=True,user_id='be031a59e74942a3930e065fa74fdaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a341bb88-eb7a-462b-a410-c01539232992),volume_type_id=a341bb88-eb7a-462b-a410-c01539232992)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Creating volume 95fd8242-f41b-41c5-b1dd-006e4f2d8937 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:49 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a9d732-b757-461f-8ae4-c169e34c6151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df758e96-b037-4851-8c7e-cabb3b7564c0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:49 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 1073741824 Jul 21 17:26:49 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4736646a-0057-4ca2-88a3-b5b993c3d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:49 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055" returned: 0 in 0.422s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:49 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Volume volume-df758e96-b037-4851-8c7e-cabb3b7564c0 (df758e96-b037-4851-8c7e-cabb3b7564c0): created successfully Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4736646a-0057-4ca2-88a3-b5b993c3d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Flow 'volume_create_manager' (636d482d-8f69-4378-a04c-247ff1819a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:49 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055 Jul 21 17:26:49 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1e8dbd54-8e62-43ff-b849-9f0890d0db0d tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created volume successfully. Jul 21 17:26:50 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ac9b04f2-6382-40ca-96e7-ff6268917055" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-ac9b04f2-6382-40ca-96e7-ff6268917055" released by "delete_volume" :: held 0.771s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Created reservations ['aec0b0fc-28b9-4a88-b019-3dde3c8f32e4', 'cfaac04b-1361-470b-a0ba-804954725c06', '7b0b344a-0c0e-4aca-8ade-85ad841c9ef8', 'f07565a7-14dd-4c51-baf3-58556dfd5742'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:50 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 1073741824" returned: 0 in 0.525s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:50 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:50 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:50 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 Jul 21 17:26:50 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-df758e96-b037-4851-8c7e-cabb3b7564c0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-df758e96-b037-4851-8c7e-cabb3b7564c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-df758e96-b037-4851-8c7e-cabb3b7564c0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-df758e96-b037-4851-8c7e-cabb3b7564c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b52f95-55ee-402e-9b11-06545825fed0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Acquiring lock "cinder-54fd4254-eaeb-46e3-a627-3a8073caae9c-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Lock "cinder-54fd4254-eaeb-46e3-a627-3a8073caae9c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:50 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937" returned: 0 in 0.394s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Acquiring lock "cinder-quobyte-54fd4254-eaeb-46e3-a627-3a8073caae9c" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:50 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:50 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 Jul 21 17:26:50 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.491s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-54fd4254-eaeb-46e3-a627-3a8073caae9c" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:50 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Deleted volume successfully. Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a7ed7-8bdf-4325-816a-c2d2dc48fd23]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Attempting download of 4461c275-8133-4ae9-8de8-661755df0a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/4461c275-8133-4ae9-8de8-661755df0a75', 'metadata': {}}])) to volume 95fd8242-f41b-41c5-b1dd-006e4f2d8937. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fb73fbf0-bce5-4011-8c39-eb5c787099d3 tempest-VolumesCloneTest-943488966 None] Lock "cinder-ac9b04f2-6382-40ca-96e7-ff6268917055-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[773b63e6-95c6-4ddc-ad98-a8e7bc846ee1]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:51 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:51 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:51 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc Jul 21 17:26:51 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:51 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0" returned: 0 in 0.599s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:51 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0 Jul 21 17:26:51 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:51 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.552s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:51 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc" returned: 0 in 0.486s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:51 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c Jul 21 17:26:51 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:51 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-df758e96-b037-4851-8c7e-cabb3b7564c0" returned: 0 in 0.360s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:51 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc Jul 21 17:26:51 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-df758e96-b037-4851-8c7e-cabb3b7564c0" released by "delete_volume" :: held 1.040s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['a1c33ad8-642c-4aaa-9b5d-9195c6478d3f', 'e5a55cc7-cc64-4b97-8466-ed6f4151b225', '7e37ddb3-c021-43aa-a064-c8a8d34bb276', '48c84a46-6dc7-4a42-b1ed-ac84244bbfec'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:51 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-54fd4254-eaeb-46e3-a627-3a8073caae9c" returned: 0 in 0.331s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Lock "cinder-quobyte-54fd4254-eaeb-46e3-a627-3a8073caae9c" released by "delete_volume" :: held 0.956s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:51 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc" returned: 1 in 0.437s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4461c275-8133-4ae9-8de8-661755df0a75_vp3d6joc' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c21ab8-29e4-4f6a-b67b-e25bcd8d14bf]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:51 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:51 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:51 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Created reservations ['5b762ea0-1da7-4840-90ea-31c70b1555e4', '1c652ef8-a45c-4ffe-8144-1b152b93414e', '3145bcd1-5c57-45d0-8a7f-17f0ff2a2b4e', 'e51d9264-7583-482b-aebe-9897a4a1de74'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:52 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:52 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:52 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD Jul 21 17:26:52 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:52 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleted volume successfully. Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a55fdab9-11d5-4de8-93c1-73ad746d0d59 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-df758e96-b037-4851-8c7e-cabb3b7564c0-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:52 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.335s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Deleted volume successfully. Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-faad3f68-af3d-49c8-b31e-b39f2de52d3b tempest-VolumesCloneTest-943488966 None] Lock "cinder-54fd4254-eaeb-46e3-a627-3a8073caae9c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:52 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:52 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD Jul 21 17:26:52 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-77a09624-7e94-4d91-b3e9-e1c13804e05c-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:52 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] 4461c275-8133-4ae9-8de8-661755df0a75 was raw, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-77a09624-7e94-4d91-b3e9-e1c13804e05c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:52 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 Jul 21 17:26:52 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-77a09624-7e94-4d91-b3e9-e1c13804e05c" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-77a09624-7e94-4d91-b3e9-e1c13804e05c" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9400ac7-e0c5-41e9-bc5b-98a4559bc36b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:53 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c Jul 21 17:26:53 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:53 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:53 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c" returned: 0 in 0.471s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937" returned: 0 in 0.628s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4461c275-8133-4ae9-8de8-661755df0a75_41ebi2vddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:26:53 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:53 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c Jul 21 17:26:53 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:53 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 1G Jul 21 17:26:53 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:53 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-77a09624-7e94-4d91-b3e9-e1c13804e05c" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-77a09624-7e94-4d91-b3e9-e1c13804e05c" released by "delete_volume" :: held 0.842s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['2cbd55ac-0c78-493e-ad50-5ae30f77384d', 'b0e92826-eba1-42ff-a2cc-1c46af15f1b7', '8cf2c2a9-3ea4-4867-8723-a1457bd5b180', '8925a3c8-4c56-48ab-976b-a8b134525c91'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:53 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 1G" returned: 0 in 0.424s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Downloaded image 4461c275-8133-4ae9-8de8-661755df0a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/4461c275-8133-4ae9-8de8-661755df0a75', 'metadata': {}}])) to volume 95fd8242-f41b-41c5-b1dd-006e4f2d8937 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Temporary image 4461c275-8133-4ae9-8de8-661755df0a75 for user be031a59e74942a3930e065fa74fdaa5 is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Marking volume 95fd8242-f41b-41c5-b1dd-006e4f2d8937 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Copying metadata from image 4461c275-8133-4ae9-8de8-661755df0a75 to 95fd8242-f41b-41c5-b1dd-006e4f2d8937. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Creating volume glance metadata for volume 95fd8242-f41b-41c5-b1dd-006e4f2d8937 backed by image 4461c275-8133-4ae9-8de8-661755df0a75 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4461c275-8133-4ae9-8de8-661755df0a75', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ec7765fd8086af9928d73ecb7ef33f54', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:53 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:54 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-4c06d9be-589f-4506-be88-4b0932c33cb0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada5ae98-2a91-41b5-8e80-bc02047e1c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937', 'volume_size': 1, 'image_id': '4461c275-8133-4ae9-8de8-661755df0a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4461c275-8133-4ae9-8de8-661755df0a75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec7765fd8086af9928d73ecb7ef33f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '570891dc1d1b43ff9eb6f2632e890eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c62f0142e15711d77b10b4a68feaae6275b1d2f28851d9ddddf5cacda93feba34d86713ca14a6f6a1bc9e620ff2a096b376f1e880c74420c44b86cb8b7f00936', 'id': '4461c275-8133-4ae9-8de8-661755df0a75', 'created_at': datetime.datetime(2026, 7, 21, 15, 26, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 26, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4461c275-8133-4ae9-8de8-661755df0a75/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8164f9-84d1-430f-a953-363697d59487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Volume volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 (95fd8242-f41b-41c5-b1dd-006e4f2d8937): created successfully Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8164f9-84d1-430f-a953-363697d59487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Flow 'volume_create_manager' (f78060d5-22db-4801-bd3f-09de157833da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-4c06d9be-589f-4506-be88-4b0932c33cb0-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-14fc1345-f89f-4f6f-83d7-317d4ae42b1b tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Created volume successfully. Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-4c06d9be-589f-4506-be88-4b0932c33cb0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-4c06d9be-589f-4506-be88-4b0932c33cb0" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:54 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.322s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleted volume successfully. Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4354e-4750-4c8d-8967-1b0074d2e1a6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-558208fd-3acf-4b3b-ab1f-30928a377634 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-77a09624-7e94-4d91-b3e9-e1c13804e05c-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:54 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 Jul 21 17:26:54 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Acquiring lock "cinder-95fd8242-f41b-41c5-b1dd-006e4f2d8937-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "cinder-95fd8242-f41b-41c5-b1dd-006e4f2d8937-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Acquiring lock "cinder-quobyte-95fd8242-f41b-41c5-b1dd-006e4f2d8937" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:54 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0" returned: 0 in 0.510s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "cinder-quobyte-95fd8242-f41b-41c5-b1dd-006e4f2d8937" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:54 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0 Jul 21 17:26:54 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[844ebaae-e504-43a9-85c5-2519d5afdd93]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:54 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 Jul 21 17:26:54 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:55 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c06d9be-589f-4506-be88-4b0932c33cb0" returned: 0 in 0.316s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-4c06d9be-589f-4506-be88-4b0932c33cb0" released by "delete_volume" :: held 0.901s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['6db950f7-27c5-4af4-ad20-3252854a154e', '1ec382e0-a4ce-447c-a642-24a4ab4a4da1', '4600d044-d9ce-4fa4-bbc6-510b6f1c15d0', '4c5b10dd-2020-4f2d-8c82-f0d080ee6e3d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:55 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937" returned: 0 in 0.487s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:55 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:55 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:55 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937 Jul 21 17:26:55 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:55 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.283s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleted volume successfully. Jul 21 17:26:55 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fcbdfcd4-7985-4330-abc8-60bc53d80568 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-4c06d9be-589f-4506-be88-4b0932c33cb0-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95fd8242-f41b-41c5-b1dd-006e4f2d8937" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "cinder-quobyte-95fd8242-f41b-41c5-b1dd-006e4f2d8937" released by "delete_volume" :: held 0.862s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:55 devstack cinder-volume[87591]: WARNING cinder.quota [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:26:55 devstack cinder-volume[87591]: WARNING cinder.quota [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Created reservations ['183b4a86-123c-4922-ba29-364ac7812d16', '63f0d4e5-871f-4496-8ee3-e05927aa1b71', '434b9e2d-0d08-4ca2-9b3c-35ef56a88223', 'f6014880-568d-41f5-9378-37d98c25c58d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:55 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:55 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:56 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.304s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Deleted volume successfully. Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92b9d7c4-113b-461f-8e39-b2cfedc9c7d3 tempest-VolumeAndVolumeTypeFromImageTest-100667312 None] Lock "cinder-95fd8242-f41b-41c5-b1dd-006e4f2d8937-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-72a99058-e921-4cf0-bc43-b707e0cd670c-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-72a99058-e921-4cf0-bc43-b707e0cd670c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-72a99058-e921-4cf0-bc43-b707e0cd670c" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-72a99058-e921-4cf0-bc43-b707e0cd670c" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8bc5f3-a4a7-476a-a7a7-71b70b5ae776]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:56 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c Jul 21 17:26:56 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Flow 'volume_create_manager' (4b8ba986-472a-4ef0-a915-57433f190056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90cf518-23c8-48e8-bb1a-6d59a4c8e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90cf518-23c8-48e8-bb1a-6d59a4c8e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1368903633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cfe6fc-c42e-42a6-9916-b44ea136ae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c775e9c27694d44b13b9bbca0fa8036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:57Z,use_quota=True,user_id='b728e165a5d74080ba2ab1272297dfef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e28b2f-d9a8-4a2d-8b8b-d72e540b2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e28b2f-d9a8-4a2d-8b8b-d72e540b2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043da39a-2745-4ac9-9b01-23b91684cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043da39a-2745-4ac9-9b01-23b91684cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cfe6fc-c42e-42a6-9916-b44ea136ae70', 'volume_name': 'volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2fdce1-8e70-4213-8ce1-b8e7986cf5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2fdce1-8e70-4213-8ce1-b8e7986cf5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c0d703-9115-4f5e-8603-6c4022d5490d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70', 'volume_size': 1} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:57 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1368903633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cfe6fc-c42e-42a6-9916-b44ea136ae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c775e9c27694d44b13b9bbca0fa8036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:26:57Z,use_quota=True,user_id='b728e165a5d74080ba2ab1272297dfef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Creating volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:26:57 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c" returned: 0 in 0.613s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:57 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 1073741824 Jul 21 17:26:57 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:57 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c Jul 21 17:26:57 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:57 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-72a99058-e921-4cf0-bc43-b707e0cd670c" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-72a99058-e921-4cf0-bc43-b707e0cd670c" released by "delete_volume" :: held 1.016s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['0df2c9be-a061-478c-9d67-78127ef08baa', '2ab064e0-0202-494e-838d-60f6d7d513e1', 'c0145710-c459-4c0e-8dbf-f1d4290d32c5', '0fa953d7-3f0b-47a0-8259-233ae35785c8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:57 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:57 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:57 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 1073741824" returned: 0 in 0.744s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:57 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 Jul 21 17:26:57 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:58 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.349s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:26:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleted volume successfully. Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fd7daa1-2374-4a1e-a2d5-48c70308f162 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-72a99058-e921-4cf0-bc43-b707e0cd670c-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:58 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" returned: 0 in 0.298s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c0d703-9115-4f5e-8603-6c4022d5490d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a265322-de71-4d44-a40d-df9d53b67eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:26:58 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Volume volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 (f7cfe6fc-c42e-42a6-9916-b44ea136ae70): created successfully Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a265322-de71-4d44-a40d-df9d53b67eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Flow 'volume_create_manager' (4b8ba986-472a-4ef0-a915-57433f190056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:26:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c16727f5-37ea-4abb-88a8-c86047394f51 tempest-VolumesSnapshotListTestJSON-1985475937 None] Created volume successfully. Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-026173cf-b38d-4343-9ab6-7395a8ae267e-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-026173cf-b38d-4343-9ab6-7395a8ae267e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-026173cf-b38d-4343-9ab6-7395a8ae267e" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-026173cf-b38d-4343-9ab6-7395a8ae267e" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ffbb26-9f21-47ab-8027-2a8b6f83f9c8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:58 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e Jul 21 17:26:58 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:59 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:59 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e Jul 21 17:26:59 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Creating offline snapshot 3afc2f07-7013-4997-a7fe-b836afb093db of volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1cc48-ddff-4d0a-8bcd-4f249dbe10e2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:59 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 Jul 21 17:26:59 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:59 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-026173cf-b38d-4343-9ab6-7395a8ae267e" returned: 0 in 0.335s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-026173cf-b38d-4343-9ab6-7395a8ae267e" released by "delete_volume" :: held 0.841s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['16f506df-2785-486f-854e-25e531ffeb7d', 'da76c895-fee9-4888-97c4-10c01ba11f79', '5463033e-193a-45a9-b168-ccde7a9b1b60', 'cf66074e-e310-4b28-835f-6c8aa3f15014'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:59 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:26:59 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:59 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" returned: 0 in 0.501s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-cd4dc791-551f-4dd1-9190-dae57bace55d-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-cd4dc791-551f-4dd1-9190-dae57bace55d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-239cd6af-ea58-4100-b76d-b1bf11111fd1" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:59 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db 1G Jul 21 17:26:59 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-239cd6af-ea58-4100-b76d-b1bf11111fd1" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-cd4dc791-551f-4dd1-9190-dae57bace55d" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-cd4dc791-551f-4dd1-9190-dae57bace55d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:26:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleting offline snapshot cd4dc791-551f-4dd1-9190-dae57bace55d of volume 239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] snapshot_file for this snap is: volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66bef88-b538-47a1-85ac-af8e347d1f8c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:00 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleted volume successfully. Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5d5f64bd-e907-43b3-b420-37b3eac512b4 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-026173cf-b38d-4343-9ab6-7395a8ae267e-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:00 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d Jul 21 17:27:00 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:00 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db 1G" returned: 0 in 0.622s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:00 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:00 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:00 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d" returned: 0 in 0.593s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-239cd6af-ea58-4100-b76d-b1bf11111fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e22b05-da28-4ed0-a391-fdbb0b3c3628]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:00 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 Jul 21 17:27:00 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:00 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:00 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db is being set with open permissions: ugo+rw Jul 21 17:27:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:00 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:00 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:01 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.276s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:01 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1" returned: 0 in 0.472s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:01 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d Jul 21 17:27:01 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:01 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info Jul 21 17:27:01 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:01 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info" returned: 0 in 0.320s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:01 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info is being set with open permissions: ugo+rw Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:01 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info Jul 21 17:27:01 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:01 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d" returned: 0 in 0.639s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:01 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d Jul 21 17:27:01 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:01 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.info" returned: 0 in 0.414s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1429b519-3bfd-48d6-b4f1-3cf53add725b tempest-VolumesSnapshotListTestJSON-1985475937 None] Create snapshot completed successfully Jul 21 17:27:02 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1.cd4dc791-551f-4dd1-9190-dae57bace55d" returned: 0 in 0.352s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-cd4dc791-551f-4dd1-9190-dae57bace55d" released by "_delete_snapshot" :: held 2.211s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-239cd6af-ea58-4100-b76d-b1bf11111fd1" released by "delete_snapshot" :: held 2.242s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['7d1e4991-54be-4f9e-8121-ab570cf94a2a', '7eba070a-12e1-4600-96f7-4419583a44b6', '19f5e62a-5a49-4c04-b9d1-31d10a83ea28', '78b3cc60-aad9-4b50-ae0d-221d0be2600c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Delete snapshot completed successfully. Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a8678c8c-8536-4109-9739-84fd8b618e3c tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-cd4dc791-551f-4dd1-9190-dae57bace55d-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Creating offline snapshot 470ffa39-1f61-485c-86ca-5e78337b25a4 of volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d63b68b-1ebc-46ea-a193-308e24dd7804]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:02 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:02 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:03 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-239cd6af-ea58-4100-b76d-b1bf11111fd1-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.450s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-239cd6af-ea58-4100-b76d-b1bf11111fd1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:03 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 1G Jul 21 17:27:03 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "cinder-quobyte-239cd6af-ea58-4100-b76d-b1bf11111fd1" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-239cd6af-ea58-4100-b76d-b1bf11111fd1" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080b05e-5b29-42d7-901b-24af0df2ff2c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:03 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 Jul 21 17:27:03 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:03 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 1G" returned: 0 in 0.619s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:03 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1" returned: 0 in 0.450s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:03 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:03 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:03 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1 Jul 21 17:27:03 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:04 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-239cd6af-ea58-4100-b76d-b1bf11111fd1" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-quobyte-239cd6af-ea58-4100-b76d-b1bf11111fd1" released by "delete_volume" :: held 0.858s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:04 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.412s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:04 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 is being set with open permissions: ugo+rw Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:04 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:04 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Created reservations ['94dd0aeb-1005-4c82-899d-07acd28e1110', 'b5a1ef34-12cc-4e72-a800-e057ec3e021d', 'e470f181-12f8-41cc-bf85-4c4263272080', 'fd9590dd-5911-4798-bc2c-8c3b0ad03f93'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:04 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:04 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:04 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:04 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1e836ca9-4b70-4ab9-90d0-c522e2f76f18 tempest-VolumesSnapshotListTestJSON-1985475937 None] Create snapshot completed successfully Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Flow 'volume_create_manager' (34efc222-2c6c-46d1-b895-acdc06cad2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3a0d4c-f605-41c2-a4fb-27e9649645b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:04 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.368s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3a0d4c-f605-41c2-a4fb-27e9649645b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced4384f-4845-4ae8-92e0-9bcbb821023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fd332d6d89466fb0e3301942f71973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:05Z,use_quota=True,user_id='f71765c4039749709ba807feb2d10a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894400d2-7e1a-4ad4-98ac-7c2cc03476f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894400d2-7e1a-4ad4-98ac-7c2cc03476f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9bdcab-312a-4968-9e32-c6c409a4cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:27:04 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Deleted volume successfully. Jul 21 17:27:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-89582ff8-28e5-4d94-b685-def4134ad2c5 tempest-CreateVolumesFromSnapshotTest-1149575390 None] Lock "cinder-239cd6af-ea58-4100-b76d-b1bf11111fd1-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Creating offline snapshot fabcd385-5650-4d0e-b355-b78447ab9820 of volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa97837f-c552-482c-9d0f-32c0a0619fec]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:05 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:05 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9bdcab-312a-4968-9e32-c6c409a4cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ced4384f-4845-4ae8-92e0-9bcbb821023f', 'volume_name': 'volume-ced4384f-4845-4ae8-92e0-9bcbb821023f', 'volume_size': 1, 'image_id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c95832d-d0d0-462e-9621-3bdbe27b860a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e943d14edbf3db76c96c61c015c3eb9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8fd332d6d89466fb0e3301942f71973', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a0fd0f2dc55fb73565ae0268887393f697bcf2f70185d0ca169f5a0c75234fd472c741d6b8565f83bf3351959652a93678406f1759e4ca9c5115436f546b9bb', 'id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'created_at': datetime.datetime(2026, 7, 21, 15, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c95832d-d0d0-462e-9621-3bdbe27b860a/file', 'properties': {}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacab375-bf54-4d0f-af8c-9cf11d8cdd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacab375-bf54-4d0f-af8c-9cf11d8cdd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356d63b6-6adb-42ad-ba31-339c16a5f099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Volume ced4384f-4845-4ae8-92e0-9bcbb821023f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ced4384f-4845-4ae8-92e0-9bcbb821023f', 'volume_size': 1, 'image_id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c95832d-d0d0-462e-9621-3bdbe27b860a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e943d14edbf3db76c96c61c015c3eb9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8fd332d6d89466fb0e3301942f71973', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a0fd0f2dc55fb73565ae0268887393f697bcf2f70185d0ca169f5a0c75234fd472c741d6b8565f83bf3351959652a93678406f1759e4ca9c5115436f546b9bb', 'id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'created_at': datetime.datetime(2026, 7, 21, 15, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c95832d-d0d0-462e-9621-3bdbe27b860a/file', 'properties': {}}, 'image_service': } Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Trying to clone ced4384f-4845-4ae8-92e0-9bcbb821023f from image 1c95832d-d0d0-462e-9621-3bdbe27b860a at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c95832d-d0d0-462e-9621-3bdbe27b860a', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:27:05 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Image download 0.00 MB at 0.00 MB/s Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ef29c6-f6f3-470c-80cd-3554292f696b]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:05 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.545s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:05 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 1G Jul 21 17:27:05 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:05 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD Jul 21 17:27:05 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:06 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:06 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD Jul 21 17:27:06 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:06 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 1G" returned: 0 in 0.673s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:06 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 Jul 21 17:27:06 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:06 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Temporary image 1c95832d-d0d0-462e-9621-3bdbe27b860a is fetched for user f71765c4039749709ba807feb2d10a7f. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9197f0b6-6797-42ef-a506-57ef12880622]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:06 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD Jul 21 17:27:06 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:06 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820" returned: 0 in 0.505s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:06 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 is being set with open permissions: ugo+rw Jul 21 17:27:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:06 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 Jul 21 17:27:06 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:07 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:07 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820" returned: 0 in 0.344s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:07 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD Jul 21 17:27:07 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:07 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b90dcc8c-b17f-4087-adc0-c07ca0eb8095 tempest-VolumesSnapshotListTestJSON-1985475937 None] Create snapshot completed successfully Jul 21 17:27:07 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced4384f-4845-4ae8-92e0-9bcbb821023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fd332d6d89466fb0e3301942f71973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:05Z,use_quota=True,user_id='f71765c4039749709ba807feb2d10a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Creating volume ced4384f-4845-4ae8-92e0-9bcbb821023f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:07 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:07 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f 1073741824 Jul 21 17:27:07 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:08 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f 1073741824" returned: 0 in 0.530s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:08 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f Jul 21 17:27:08 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:08 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f" returned: 0 in 0.385s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Attempting download of 1c95832d-d0d0-462e-9621-3bdbe27b860a ((None, [{'url': 'file:///opt/stack/data/glance/images/1c95832d-d0d0-462e-9621-3bdbe27b860a', 'metadata': {}}])) to volume ced4384f-4845-4ae8-92e0-9bcbb821023f. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb29492-6f22-4e33-8e7a-e78aaf44f36f]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:08 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q Jul 21 17:27:08 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:09 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q" returned: 0 in 0.474s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-fabcd385-5650-4d0e-b355-b78447ab9820-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-fabcd385-5650-4d0e-b355-b78447ab9820-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-fabcd385-5650-4d0e-b355-b78447ab9820" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:09 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q Jul 21 17:27:09 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (ba3e3ea6-96c4-4c4d-8cf0-159035dceafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084d7924-55b7-4fec-b025-de28475addb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084d7924-55b7-4fec-b025-de28475addb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622873828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5beba022-b072-4e92-b548-49963c60d802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:09Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a99324-aa3b-424d-8d68-416b67752ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a99324-aa3b-424d-8d68-416b67752ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0672540a-c0ab-46a9-90af-9e6555732b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0672540a-c0ab-46a9-90af-9e6555732b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5beba022-b072-4e92-b548-49963c60d802', 'volume_name': 'volume-5beba022-b072-4e92-b548-49963c60d802', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547c5db6-8219-471f-9c93-29e76115abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547c5db6-8219-471f-9c93-29e76115abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87729717-542b-426b-8eab-ed0746e45d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:09 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume 5beba022-b072-4e92-b548-49963c60d802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5beba022-b072-4e92-b548-49963c60d802', 'volume_size': 1} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622873828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5beba022-b072-4e92-b548-49963c60d802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:09Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Creating volume 5beba022-b072-4e92-b548-49963c60d802 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:09 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-fabcd385-5650-4d0e-b355-b78447ab9820" acquired by "_delete_snapshot" :: waited 0.141s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Deleting offline snapshot fabcd385-5650-4d0e-b355-b78447ab9820 of volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:27:09 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 1073741824 Jul 21 17:27:09 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] snapshot_file for this snap is: volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaf411d-bdcd-4fbc-a836-9365c83644ef]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:09 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q" returned: 1 in 0.384s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c95832d-d0d0-462e-9621-3bdbe27b860a_qs_dq32q' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad1f8a7-098e-439c-8370-73273b4aa6e1]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:09 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 Jul 21 17:27:09 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:09 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD Jul 21 17:27:09 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:09 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:09 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:09 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 1073741824" returned: 0 in 0.613s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820" returned: 0 in 0.566s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017e3d6-102e-45cd-8809-fa9044325c08]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:10 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 Jul 21 17:27:10 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:10 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD Jul 21 17:27:10 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:10 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:10 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:10 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD" returned: 1 in 0.523s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] 1c95832d-d0d0-462e-9621-3bdbe27b860a was raw, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:10 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802" returned: 0 in 0.420s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:10 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:10 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f Jul 21 17:27:10 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87729717-542b-426b-8eab-ed0746e45d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5beba022-b072-4e92-b548-49963c60d802', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f7e05f-3a7a-4003-877d-fc6d5a535797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.488s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:10 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume volume-5beba022-b072-4e92-b548-49963c60d802 (5beba022-b072-4e92-b548-49963c60d802): created successfully Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f7e05f-3a7a-4003-877d-fc6d5a535797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (ba3e3ea6-96c4-4c4d-8cf0-159035dceafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:10 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 Jul 21 17:27:10 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-dc57e145-b042-4746-8e52-9740ca5ac2ce tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created volume successfully. Jul 21 17:27:10 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f" returned: 0 in 0.482s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c95832d-d0d0-462e-9621-3bdbe27b860a_j4l680u2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:27:10 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:10 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:10 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f 1G Jul 21 17:27:10 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820" returned: 0 in 0.456s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:11 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820 Jul 21 17:27:11 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:11 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.fabcd385-5650-4d0e-b355-b78447ab9820" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:11 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f 1G" returned: 0 in 0.385s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Downloaded image 1c95832d-d0d0-462e-9621-3bdbe27b860a ((None, [{'url': 'file:///opt/stack/data/glance/images/1c95832d-d0d0-462e-9621-3bdbe27b860a', 'metadata': {}}])) to volume ced4384f-4845-4ae8-92e0-9bcbb821023f successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Temporary image 1c95832d-d0d0-462e-9621-3bdbe27b860a for user f71765c4039749709ba807feb2d10a7f is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Marking volume ced4384f-4845-4ae8-92e0-9bcbb821023f as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-fabcd385-5650-4d0e-b355-b78447ab9820" released by "_delete_snapshot" :: held 1.981s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Copying metadata from image 1c95832d-d0d0-462e-9621-3bdbe27b860a to ced4384f-4845-4ae8-92e0-9bcbb821023f. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Creating volume glance metadata for volume ced4384f-4845-4ae8-92e0-9bcbb821023f backed by image 1c95832d-d0d0-462e-9621-3bdbe27b860a with: {'image_id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e943d14edbf3db76c96c61c015c3eb9f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" released by "delete_snapshot" :: held 2.140s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356d63b6-6adb-42ad-ba31-339c16a5f099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced4384f-4845-4ae8-92e0-9bcbb821023f', 'volume_size': 1, 'image_id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c95832d-d0d0-462e-9621-3bdbe27b860a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e943d14edbf3db76c96c61c015c3eb9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8fd332d6d89466fb0e3301942f71973', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a0fd0f2dc55fb73565ae0268887393f697bcf2f70185d0ca169f5a0c75234fd472c741d6b8565f83bf3351959652a93678406f1759e4ca9c5115436f546b9bb', 'id': '1c95832d-d0d0-462e-9621-3bdbe27b860a', 'created_at': datetime.datetime(2026, 7, 21, 15, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c95832d-d0d0-462e-9621-3bdbe27b860a/file', 'properties': {}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0aaca4-71fb-439e-a1e7-bbd3a4b747e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Created reservations ['2d342a2f-56fd-4af5-b673-00df5ad7c4eb', '5baa1cd0-6bf2-447a-960e-fce34011d4c9', '5e5e6811-dc4c-4e6c-ad5c-3b05449f6234', '380d3ba0-cd98-4027-a86b-d358a8d2c9b9'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:11 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Volume volume-ced4384f-4845-4ae8-92e0-9bcbb821023f (ced4384f-4845-4ae8-92e0-9bcbb821023f): created successfully Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0aaca4-71fb-439e-a1e7-bbd3a4b747e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Flow 'volume_create_manager' (34efc222-2c6c-46d1-b895-acdc06cad2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8865cb0c-a452-4d5f-9ef8-45545baf6230 tempest-VolumeImageDependencyTests-1356651002 None] Created volume successfully. Jul 21 17:27:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Delete snapshot completed successfully. Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c6360144-dd35-4a75-9aec-5dc5764ae8d6 tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-fabcd385-5650-4d0e-b355-b78447ab9820-delete_snapshot" released by "delete_snapshot" :: held 2.421s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (28072e90-67ad-416f-93be-c1d95035f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe44ac7-8f5c-48f7-b1e4-dd6b7a85196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe44ac7-8f5c-48f7-b1e4-dd6b7a85196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531845900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5157388a-056d-49fd-99d2-5f33660c6384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:12Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112c1c77-b7f2-419a-882b-ae5d983d62a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112c1c77-b7f2-419a-882b-ae5d983d62a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acacabc-8d5b-498a-9318-3e214278b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acacabc-8d5b-498a-9318-3e214278b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5157388a-056d-49fd-99d2-5f33660c6384', 'volume_name': 'volume-5157388a-056d-49fd-99d2-5f33660c6384', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099eeee6-660b-4a3c-a33a-4d69f6dc8797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099eeee6-660b-4a3c-a33a-4d69f6dc8797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d8ceb-3557-46ef-98de-19ab09333ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:11 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume 5157388a-056d-49fd-99d2-5f33660c6384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5157388a-056d-49fd-99d2-5f33660c6384', 'volume_size': 1} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531845900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5157388a-056d-49fd-99d2-5f33660c6384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:12Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Creating volume 5157388a-056d-49fd-99d2-5f33660c6384 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:11 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:11 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 1073741824 Jul 21 17:27:11 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Acquiring lock "cinder-ced4384f-4845-4ae8-92e0-9bcbb821023f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Lock "cinder-ced4384f-4845-4ae8-92e0-9bcbb821023f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=190,cinder:DELETE=13,cinder:SELECT=149,cinder:INSERT=62 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Acquiring lock "cinder-quobyte-ced4384f-4845-4ae8-92e0-9bcbb821023f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Lock "cinder-quobyte-ced4384f-4845-4ae8-92e0-9bcbb821023f" acquired by "delete_volume" :: waited 0.050s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55daf1-d58e-422a-81a3-5a1fe11475eb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (b1818899-284a-4c78-abbc-8c2ac9f009d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b07c98-4783-4328-8211-ef8a5f770574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:12 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-470ffa39-1f61-485c-86ca-5e78337b25a4-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 1073741824" returned: 0 in 0.837s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b07c98-4783-4328-8211-ef8a5f770574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834111731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163b668a-9b3d-407e-a825-0b33d00f465d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:13Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c1ec79-d4e2-4667-a541-e65372e3b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:12 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f Jul 21 17:27:12 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c1ec79-d4e2-4667-a541-e65372e3b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86c684c-cf59-49a8-a07a-15b5435735a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86c684c-cf59-49a8-a07a-15b5435735a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163b668a-9b3d-407e-a825-0b33d00f465d', 'volume_name': 'volume-163b668a-9b3d-407e-a825-0b33d00f465d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5271c226-3be2-429f-a520-e53cf20a348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5271c226-3be2-429f-a520-e53cf20a348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1873173c-3fb4-4edf-bf49-a80d6efb43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume 163b668a-9b3d-407e-a825-0b33d00f465d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163b668a-9b3d-407e-a825-0b33d00f465d', 'volume_size': 1} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-470ffa39-1f61-485c-86ca-5e78337b25a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.144s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-470ffa39-1f61-485c-86ca-5e78337b25a4" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-470ffa39-1f61-485c-86ca-5e78337b25a4" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Deleting offline snapshot 470ffa39-1f61-485c-86ca-5e78337b25a4 of volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:27:13 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 Jul 21 17:27:13 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] snapshot_file for this snap is: volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fd9f47-8a8c-4bdf-856c-2c19229d2d94]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=194,cinder:SELECT=150,cinder:INSERT=48,cinder:DELETE=21 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:13 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (aad77fe2-a73a-464a-92f4-bcf7a3fa3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f3d021-7425-4dde-be7f-ff32ef05a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f" returned: 0 in 0.656s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f3d021-7425-4dde-be7f-ff32ef05a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694681798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4756c9d-9f3d-4603-a984-8796c30a4e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:13Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:13 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f Jul 21 17:27:13 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:13 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:13 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4e5c73-441c-406e-8713-ce41712ad8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4e5c73-441c-406e-8713-ce41712ad8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f743c0-5153-4d91-b4b9-1dae7e72eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f743c0-5153-4d91-b4b9-1dae7e72eed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4756c9d-9f3d-4603-a984-8796c30a4e7e', 'volume_name': 'volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8bd74b-9e76-461f-986b-e8f3b4a033e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8bd74b-9e76-461f-986b-e8f3b4a033e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1285fcb-72c0-4b00-a1fb-c85f0f4ce438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume b4756c9d-9f3d-4603-a984-8796c30a4e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e', 'volume_size': 1} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:13 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384" returned: 0 in 0.625s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834111731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163b668a-9b3d-407e-a825-0b33d00f465d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:13Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Creating volume 163b668a-9b3d-407e-a825-0b33d00f465d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:13 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:13 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ced4384f-4845-4ae8-92e0-9bcbb821023f" returned: 0 in 0.339s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:13 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d 1073741824 Jul 21 17:27:13 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d8ceb-3557-46ef-98de-19ab09333ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5157388a-056d-49fd-99d2-5f33660c6384', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d148f1a6-23f6-438d-8a57-b794d8977b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Lock "cinder-quobyte-ced4384f-4845-4ae8-92e0-9bcbb821023f" released by "delete_volume" :: held 1.123s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume volume-5157388a-056d-49fd-99d2-5f33660c6384 (5157388a-056d-49fd-99d2-5f33660c6384): created successfully Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d148f1a6-23f6-438d-8a57-b794d8977b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (28072e90-67ad-416f-93be-c1d95035f886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fcfa2db3-f696-4629-860f-12530697f035 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created volume successfully. Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Created reservations ['c86aa56e-a485-4e5d-8c86-41f6644453c3', 'ed51df8f-9aab-42d8-8cc7-274221cd0c16', 'cf82b33d-2036-4f53-918e-8a5e00bb57c2', '7003e03d-55ad-41bd-80c6-e3f5cd47b8e7'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:13 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (dd9c2b81-dd29-4a6c-a3e9-8a3621068fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a408e3-9d50-4cde-a85b-419824fbb3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.941s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a408e3-9d50-4cde-a85b-419824fbb3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989013790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc81a8c-6f2c-4947-bcbd-2cce79b1840f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:14Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c2005e-ea80-47bb-8e6c-42a84a3ef640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c2005e-ea80-47bb-8e6c-42a84a3ef640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcfe588-8e0a-47d1-b3a3-4c2b87c2c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcfe588-8e0a-47d1-b3a3-4c2b87c2c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc81a8c-6f2c-4947-bcbd-2cce79b1840f', 'volume_name': 'volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c6b33d-736b-4bf8-b050-b1f3556fad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c6b33d-736b-4bf8-b050-b1f3556fad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1204dc1a-9be2-446c-affe-0a9a19404532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume 7cc81a8c-6f2c-4947-bcbd-2cce79b1840f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f', 'volume_size': 1} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4393520-61c1-45f0-af8a-ece803985357]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:14 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:14 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:14 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:14 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.318s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d 1073741824" returned: 0 in 0.781s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Deleted volume successfully. Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1a13df67-62a0-4e12-ada6-59625306e7c1 tempest-VolumeImageDependencyTests-1356651002 None] Lock "cinder-ced4384f-4845-4ae8-92e0-9bcbb821023f-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:14 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d Jul 21 17:27:14 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (fa255971-019a-4a12-bd20-454f7c5672ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c001188-b4ba-43f3-8fce-c624d2d7546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.536s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c001188-b4ba-43f3-8fce-c624d2d7546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-334988396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010cd585-3bba-4582-aaec-f56ca2e0d722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:15Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:14 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43532c3-983e-480d-8159-dd90aac1acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43532c3-983e-480d-8159-dd90aac1acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ed9e4c-61dd-4c8b-ad91-cd504f609cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ed9e4c-61dd-4c8b-ad91-cd504f609cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010cd585-3bba-4582-aaec-f56ca2e0d722', 'volume_name': 'volume-010cd585-3bba-4582-aaec-f56ca2e0d722', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d44c20-be96-4aa5-9d36-c3e2829b3664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d44c20-be96-4aa5-9d36-c3e2829b3664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd124cd-e006-4891-89be-994da980eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume 010cd585-3bba-4582-aaec-f56ca2e0d722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010cd585-3bba-4582-aaec-f56ca2e0d722', 'volume_size': 1} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:14 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d" returned: 0 in 0.320s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694681798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4756c9d-9f3d-4603-a984-8796c30a4e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:13Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Creating volume b4756c9d-9f3d-4603-a984-8796c30a4e7e {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:14 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1873173c-3fb4-4edf-bf49-a80d6efb43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163b668a-9b3d-407e-a825-0b33d00f465d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794d2804-c523-475d-8fdc-2d6c4820c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:14 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e 1073741824 Jul 21 17:27:14 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume volume-163b668a-9b3d-407e-a825-0b33d00f465d (163b668a-9b3d-407e-a825-0b33d00f465d): created successfully Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794d2804-c523-475d-8fdc-2d6c4820c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (b1818899-284a-4c78-abbc-8c2ac9f009d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c8eafc3f-9cd8-4907-a8f1-24df918c2b73 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created volume successfully. Jul 21 17:27:15 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.506s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:15 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4 Jul 21 17:27:15 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:15 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e 1073741824" returned: 0 in 0.637s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:15 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.470ffa39-1f61-485c-86ca-5e78337b25a4" returned: 0 in 0.324s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-470ffa39-1f61-485c-86ca-5e78337b25a4" released by "_delete_snapshot" :: held 2.570s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" released by "delete_snapshot" :: held 2.650s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:15 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e Jul 21 17:27:15 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Created reservations ['424cd771-a22d-4a4c-9ee3-6fcd66eb9a60', 'b939bc59-b42a-4ca9-b8a9-094f336c7552', 'e1bdf14c-a7da-4664-8129-73c7dd87d108', 'cd02970e-a030-4a80-a8b0-950c5c5a01dc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Delete snapshot completed successfully. Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-fdd303b0-82bc-45df-aa67-2307840a862c tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-470ffa39-1f61-485c-86ca-5e78337b25a4-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:15 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e" returned: 0 in 0.351s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989013790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc81a8c-6f2c-4947-bcbd-2cce79b1840f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:14Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Creating volume 7cc81a8c-6f2c-4947-bcbd-2cce79b1840f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:15 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1285fcb-72c0-4b00-a1fb-c85f0f4ce438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9621d4ba-8a20-4d74-8ce4-807ed79fa04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:15 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f 1073741824 Jul 21 17:27:15 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e (b4756c9d-9f3d-4603-a984-8796c30a4e7e): created successfully Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9621d4ba-8a20-4d74-8ce4-807ed79fa04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (aad77fe2-a73a-464a-92f4-bcf7a3fa3000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-3afc2f07-7013-4997-a7fe-b836afb093db-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b88540df-02a7-4640-931b-3d58d148a900 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created volume successfully. Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-3afc2f07-7013-4997-a7fe-b836afb093db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-3afc2f07-7013-4997-a7fe-b836afb093db" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-3afc2f07-7013-4997-a7fe-b836afb093db" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Deleting offline snapshot 3afc2f07-7013-4997-a7fe-b836afb093db of volume f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] snapshot_file for this snap is: volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[260af423-6f82-4597-b519-b40be1788c2c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:16 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:16 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:16 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f 1073741824" returned: 0 in 0.639s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:16 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.481s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:16 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f Jul 21 17:27:16 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a2c54-2187-43f7-bb89-a645692f59a2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:16 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 Jul 21 17:27:16 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:16 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f" returned: 0 in 0.332s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-334988396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010cd585-3bba-4582-aaec-f56ca2e0d722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b88f8ebdbc4c5cbf07289d489a2b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:15Z,use_quota=True,user_id='53a560225b824c8a8606d900258ed77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Creating volume 010cd585-3bba-4582-aaec-f56ca2e0d722 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:17 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 1073741824 Jul 21 17:27:17 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1204dc1a-9be2-446c-affe-0a9a19404532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e55866-e820-4088-80dc-9996282ce4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f (7cc81a8c-6f2c-4947-bcbd-2cce79b1840f): created successfully Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e55866-e820-4088-80dc-9996282ce4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (dd9c2b81-dd29-4a6c-a3e9-8a3621068fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ec268b5e-bebf-4073-a8ad-302acfe0373c tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created volume successfully. Jul 21 17:27:17 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" returned: 0 in 0.503s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:17 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:17 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:17 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 1073741824" returned: 0 in 0.632s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:17 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 Jul 21 17:27:17 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:17 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.637s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:17 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db Jul 21 17:27:17 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:18 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722" returned: 0 in 0.356s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd124cd-e006-4891-89be-994da980eb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010cd585-3bba-4582-aaec-f56ca2e0d722', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389ff01d-871e-460e-bd01-b331cda82869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Volume volume-010cd585-3bba-4582-aaec-f56ca2e0d722 (010cd585-3bba-4582-aaec-f56ca2e0d722): created successfully Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389ff01d-871e-460e-bd01-b331cda82869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Flow 'volume_create_manager' (fa255971-019a-4a12-bd20-454f7c5672ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ccca5a68-92a7-41c3-80af-55ab32444ab3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created volume successfully. Jul 21 17:27:18 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70.3afc2f07-7013-4997-a7fe-b836afb093db" returned: 0 in 0.366s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-3afc2f07-7013-4997-a7fe-b836afb093db" released by "_delete_snapshot" :: held 2.151s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" released by "delete_snapshot" :: held 2.200s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Created reservations ['38ac3baf-de2a-4217-90a0-a5a67d8bb5a5', '5846e8f1-c624-4e06-b5e4-c2bbad0ea4ab', 'ea5edb36-8e24-4b4e-b3bf-40e9d431e0fe', '54e25eb7-1ce5-4552-ae0d-e80734e1a305'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Delete snapshot completed successfully. Jul 21 17:27:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a82fe8d7-86d6-441a-84c9-dae47112e52b tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-3afc2f07-7013-4997-a7fe-b836afb093db-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-010cd585-3bba-4582-aaec-f56ca2e0d722-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-010cd585-3bba-4582-aaec-f56ca2e0d722-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-quobyte-010cd585-3bba-4582-aaec-f56ca2e0d722" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-010cd585-3bba-4582-aaec-f56ca2e0d722" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ae7cc-4485-486d-8f4b-1436f114f2a7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Flow 'volume_create_manager' (5db8dd91-67ca-4ca5-bcc5-4147bc978cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a914e2f0-f670-4ca9-8dcc-368a4e0a65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-f7cfe6fc-c42e-42a6-9916-b44ea136ae70-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a914e2f0-f670-4ca9-8dcc-368a4e0a65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73b834d-c55d-4e46-8bf6-a371ff08764f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9331b41f95d4a9a9c5d28a72c97639e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:19Z,use_quota=True,user_id='d3b976eb8fec44e78c71b81219591f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01964c4d-7ece-474c-a878-ec53426e0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01964c4d-7ece-474c-a878-ec53426e0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7403f4-635a-4b4f-be2d-86977b1a582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7403f4-635a-4b4f-be2d-86977b1a582e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73b834d-c55d-4e46-8bf6-a371ff08764f', 'volume_name': 'volume-c73b834d-c55d-4e46-8bf6-a371ff08764f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44efc567-cc3d-4a4e-8329-d3fb813ca28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44efc567-cc3d-4a4e-8329-d3fb813ca28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bbdf08-5ba5-4bf3-a57c-81e5ed96d3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Volume c73b834d-c55d-4e46-8bf6-a371ff08764f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73b834d-c55d-4e46-8bf6-a371ff08764f', 'volume_size': 1} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73b834d-c55d-4e46-8bf6-a371ff08764f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9331b41f95d4a9a9c5d28a72c97639e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:19Z,use_quota=True,user_id='d3b976eb8fec44e78c71b81219591f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Creating volume c73b834d-c55d-4e46-8bf6-a371ff08764f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-f7cfe6fc-c42e-42a6-9916-b44ea136ae70-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:19 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f 1073741824 Jul 21 17:27:19 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 Jul 21 17:27:19 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:19 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[87144882-24be-4d26-9775-6f3b9b36fcbe]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:19 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 Jul 21 17:27:19 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:19 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722" returned: 0 in 0.568s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:19 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722 Jul 21 17:27:19 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:20 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" returned: 0 in 0.537s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:20 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70 Jul 21 17:27:20 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:20 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-010cd585-3bba-4582-aaec-f56ca2e0d722" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:20 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f 1073741824" returned: 0 in 0.803s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-010cd585-3bba-4582-aaec-f56ca2e0d722" released by "delete_volume" :: held 1.045s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created reservations ['e9ad837d-9afb-4874-b64f-58dcb0da053c', '0cf87a28-7119-4c0b-addc-1c91d473d162', '74395b17-017a-4c29-b102-7b145962f1ab', '1d196394-7a2e-410a-ac6c-a8de7ae4a413'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:20 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f Jul 21 17:27:20 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:20 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" returned: 0 in 0.345s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-quobyte-f7cfe6fc-c42e-42a6-9916-b44ea136ae70" released by "delete_volume" :: held 1.024s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:20 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:20 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Created reservations ['7e93b1fc-e1bf-49ed-8200-aca446d49d72', '8cf3270f-ffb6-45a7-8b26-15f5af1f9a8c', '125c9ae6-ba89-49aa-9977-93561b99a754', '09de6190-b5d0-42c0-9aa8-525e6672a92a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:20 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:20 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:20 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f" returned: 0 in 0.430s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bbdf08-5ba5-4bf3-a57c-81e5ed96d3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73b834d-c55d-4e46-8bf6-a371ff08764f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675aaa24-4e81-40e1-8abf-7fd88acac55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Volume volume-c73b834d-c55d-4e46-8bf6-a371ff08764f (c73b834d-c55d-4e46-8bf6-a371ff08764f): created successfully Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675aaa24-4e81-40e1-8abf-7fd88acac55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Flow 'volume_create_manager' (5db8dd91-67ca-4ca5-bcc5-4147bc978cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c4d48d8a-1b2b-4734-8e83-f7663f2491fd tempest-CinderUnicodeTest-713574760 None] Created volume successfully. Jul 21 17:27:21 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.393s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Deleted volume successfully. Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a724ce81-a65d-4714-8f60-74374c3e09e0 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-010cd585-3bba-4582-aaec-f56ca2e0d722-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:21 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Deleted volume successfully. Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b15445e2-b7d1-404e-954a-6155afc9b22e tempest-VolumesSnapshotListTestJSON-1985475937 None] Lock "cinder-f7cfe6fc-c42e-42a6-9916-b44ea136ae70-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-quobyte-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce00bc3-e4d2-4394-9b93-b18ea3c10fbb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:21 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f Jul 21 17:27:21 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Flow 'volume_create_manager' (8b882b4b-860a-4e0f-9d91-a82be79f9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7967ec95-d3de-4444-b89b-3633531e246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:22 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f" returned: 0 in 0.589s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7967ec95-d3de-4444-b89b-3633531e246b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1923356895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff207e7-ea54-44f9-b9c9-05646f8ab9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9331b41f95d4a9a9c5d28a72c97639e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:22Z,use_quota=True,user_id='d3b976eb8fec44e78c71b81219591f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678794c1-f886-448f-9c55-e6ee3805886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678794c1-f886-448f-9c55-e6ee3805886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a4e6d0-dde4-4368-b861-0e0d1c1cb911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a4e6d0-dde4-4368-b861-0e0d1c1cb911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff207e7-ea54-44f9-b9c9-05646f8ab9af', 'volume_name': 'volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:22 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f Jul 21 17:27:22 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526e34e-ab77-4776-968a-7aea7bddbac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526e34e-ab77-4776-968a-7aea7bddbac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d1ad8d-20f5-465f-bfe5-2273b7913048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:22 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Volume 6ff207e7-ea54-44f9-b9c9-05646f8ab9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af', 'volume_size': 1} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1923356895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff207e7-ea54-44f9-b9c9-05646f8ab9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9331b41f95d4a9a9c5d28a72c97639e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:22Z,use_quota=True,user_id='d3b976eb8fec44e78c71b81219591f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Creating volume 6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:22 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:22 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af 1073741824 Jul 21 17:27:22 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:22 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f" returned: 0 in 0.380s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f" released by "delete_volume" :: held 1.027s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created reservations ['2c7d6d66-095f-445d-a33a-50a426085cf0', 'a67c7c98-93cf-4e77-9400-7b31d4444c3b', '3f6891aa-bb2f-410b-b636-a8fab0ddfd57', '76fa15b3-ebbf-4434-98aa-377576af311e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:22 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:22 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:23 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af 1073741824" returned: 0 in 0.732s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:23 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Deleted volume successfully. Jul 21 17:27:23 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af Jul 21 17:27:23 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7e65c33c-fb93-4cc1-8105-848b07192741 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-7cc81a8c-6f2c-4947-bcbd-2cce79b1840f-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:23 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d1ad8d-20f5-465f-bfe5-2273b7913048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6348e137-c36f-4596-a9f6-333ffed748c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Volume volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af (6ff207e7-ea54-44f9-b9c9-05646f8ab9af): created successfully Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6348e137-c36f-4596-a9f6-333ffed748c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Flow 'volume_create_manager' (8b882b4b-860a-4e0f-9d91-a82be79f9151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8169f11c-dc0e-4060-a3c3-10e0b4a5e815 tempest-CinderUnicodeTest-713574760 None] Created volume successfully. Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-b4756c9d-9f3d-4603-a984-8796c30a4e7e-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-b4756c9d-9f3d-4603-a984-8796c30a4e7e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-quobyte-b4756c9d-9f3d-4603-a984-8796c30a4e7e" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-b4756c9d-9f3d-4603-a984-8796c30a4e7e" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9249cb3-f617-4f2b-827c-ac52147804f3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:24 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e Jul 21 17:27:24 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:24 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e" returned: 0 in 0.458s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:24 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e Jul 21 17:27:24 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Creating offline snapshot 55cf9d55-7b85-4ebb-8f4d-73aacfee70cf of volume 6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a093f-79ef-4eac-831d-de5f40e8dbff]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:24 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b4756c9d-9f3d-4603-a984-8796c30a4e7e" returned: 0 in 0.366s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-b4756c9d-9f3d-4603-a984-8796c30a4e7e" released by "delete_volume" :: held 0.883s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created reservations ['e090e541-8641-44bf-aeaa-35dd4fb60009', 'e9ab88ed-826d-4573-a331-ecd09e4eed14', '04f1bf38-a582-49b4-83f4-78671d7cb842', 'dd52102f-338e-42af-a02c-92f899d3cb7c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:24 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af Jul 21 17:27:24 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:25 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:25 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-163b668a-9b3d-407e-a825-0b33d00f465d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-163b668a-9b3d-407e-a825-0b33d00f465d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-quobyte-163b668a-9b3d-407e-a825-0b33d00f465d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-163b668a-9b3d-407e-a825-0b33d00f465d" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0b6f19-d056-41ab-a663-17b92cda1bab]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:25 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:25 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Deleted volume successfully. Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" returned: 0 in 0.635s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38eba470-0009-4019-b2cc-98c9399431f3 tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-b4756c9d-9f3d-4603-a984-8796c30a4e7e-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:25 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf 1G Jul 21 17:27:25 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:25 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d Jul 21 17:27:25 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:25 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d" returned: 0 in 0.524s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:25 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d Jul 21 17:27:25 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:26 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf 1G" returned: 0 in 0.609s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:26 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf Jul 21 17:27:26 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:26 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-163b668a-9b3d-407e-a825-0b33d00f465d" returned: 0 in 0.294s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-163b668a-9b3d-407e-a825-0b33d00f465d" released by "delete_volume" :: held 0.886s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created reservations ['627abce7-f153-446a-a80b-6b7e856cb7d4', '60c3c0c3-cf19-4076-a48d-d30395f13ca0', 'c65e2d38-4e91-448d-acd7-8ecb23e422ea', '183bd9bf-1bba-4e20-98a8-00649bf2c065'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:26 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:26 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:26 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" returned: 0 in 0.478s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:26 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf is being set with open permissions: ugo+rw Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:26 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf Jul 21 17:27:26 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:26 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.299s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Deleted volume successfully. Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-56894e70-c36e-481b-980b-64a030efc90a tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-163b668a-9b3d-407e-a825-0b33d00f465d-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:26 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:26 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info Jul 21 17:27:26 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:27 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info" returned: 0 in 0.361s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:27 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info is being set with open permissions: ugo+rw Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:27 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info Jul 21 17:27:27 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-5157388a-056d-49fd-99d2-5f33660c6384-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-5157388a-056d-49fd-99d2-5f33660c6384-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:27 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.info" returned: 0 in 0.363s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-quobyte-5157388a-056d-49fd-99d2-5f33660c6384" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-5157388a-056d-49fd-99d2-5f33660c6384" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-26ff8593-c133-4965-952e-47644188faf8 tempest-CinderUnicodeTest-713574760 None] Create snapshot completed successfully Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5714043c-b308-4482-976a-e734862bc794]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:27 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 Jul 21 17:27:27 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-55cf9d55-7b85-4ebb-8f4d-73aacfee70cf-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Lock "cinder-55cf9d55-7b85-4ebb-8f4d-73aacfee70cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-quobyte-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-quobyte-55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Deleting offline snapshot 55cf9d55-7b85-4ebb-8f4d-73aacfee70cf of volume 6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] snapshot_file for this snap is: volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a95d00-f659-48fa-9f67-a516ea6a2ffa]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:28 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384" returned: 0 in 0.533s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:28 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384 Jul 21 17:27:28 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:28 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf Jul 21 17:27:28 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:28 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5157388a-056d-49fd-99d2-5f33660c6384" returned: 0 in 0.374s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-5157388a-056d-49fd-99d2-5f33660c6384" released by "delete_volume" :: held 0.970s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created reservations ['3f249e74-780b-4d7f-b6f5-40a38e481f26', '2f0146b0-c06b-4092-bec6-04780af94d82', 'db64dfd6-5785-4aeb-a71b-0586a6fb257b', 'cdf5a095-b766-4ea0-be29-2e30b96437a1'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:28 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" returned: 0 in 0.639s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0785ec9-62c4-4203-8b2f-16c9ccbf9b9c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:28 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:28 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:29 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af Jul 21 17:27:29 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:29 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Deleted volume successfully. Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d904b48f-4c1c-43d8-a3b3-ea319b66f40b tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-5157388a-056d-49fd-99d2-5f33660c6384-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:29 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" returned: 0 in 0.564s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:29 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf Jul 21 17:27:29 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:29 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-5beba022-b072-4e92-b548-49963c60d802-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-5beba022-b072-4e92-b548-49963c60d802-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:29 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf Jul 21 17:27:29 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "cinder-quobyte-5beba022-b072-4e92-b548-49963c60d802" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-5beba022-b072-4e92-b548-49963c60d802" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[114404e2-7d39-4dee-889a-dbc038e112c6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:30 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 Jul 21 17:27:30 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:30 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af.55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-55cf9d55-7b85-4ebb-8f4d-73aacfee70cf" released by "_delete_snapshot" :: held 2.198s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" released by "delete_snapshot" :: held 2.236s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Created reservations ['45dafbc9-f656-42fc-9eac-d14ff3014bd6', '19a60997-724b-4299-a6a1-43a52106f6fb', 'ccb571f8-548e-4651-bd91-f3c1e201fc6d', 'ebf1c025-e6de-44c0-8841-49ed2b776955'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:30 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802" returned: 0 in 0.519s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:30 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802 Jul 21 17:27:30 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Delete snapshot completed successfully. Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4307bd3f-868e-4ab8-8ba0-992b4b520ddd tempest-CinderUnicodeTest-713574760 None] Lock "cinder-55cf9d55-7b85-4ebb-8f4d-73aacfee70cf-delete_snapshot" released by "delete_snapshot" :: held 2.483s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:30 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5beba022-b072-4e92-b548-49963c60d802" returned: 0 in 0.285s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-quobyte-5beba022-b072-4e92-b548-49963c60d802" released by "delete_volume" :: held 0.858s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Created reservations ['f02d8f37-8dc4-4825-b378-b3b2127a41be', 'b4dddc05-4180-4961-89ae-da7a1bdfc38e', 'd08d96da-f0a9-4c0a-a6a4-1b0fed9ccf02', 'bd65b73e-ce92-4b3e-991b-c020641cdb02'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:31 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:31 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-6ff207e7-ea54-44f9-b9c9-05646f8ab9af-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-6ff207e7-ea54-44f9-b9c9-05646f8ab9af-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:31 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.451s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-quobyte-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Deleted volume successfully. Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" acquired by "delete_volume" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-076bc14b-4740-448a-be4e-7dab3b4ebf5f tempest-CreateVolumesFromSourceVolumeTest-1095203087 None] Lock "cinder-5beba022-b072-4e92-b548-49963c60d802-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4117ea7-970b-44d1-8352-ca7626258f43]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:31 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af Jul 21 17:27:31 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:32 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" returned: 0 in 0.476s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:32 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af Jul 21 17:27:32 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:32 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" returned: 0 in 0.320s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-6ff207e7-ea54-44f9-b9c9-05646f8ab9af" released by "delete_volume" :: held 0.888s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Created reservations ['2048a06a-605e-4aa0-b0a0-6a5ea46f0ac4', 'e575f24a-5eb8-4c63-964a-579e456dc077', '99c57551-b004-42eb-ba1e-0a6732d51fdb', 'b946ea54-f12f-4e07-b529-d00d98045434'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:32 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:32 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-c73b834d-c55d-4e46-8bf6-a371ff08764f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-c73b834d-c55d-4e46-8bf6-a371ff08764f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "cinder-quobyte-c73b834d-c55d-4e46-8bf6-a371ff08764f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-c73b834d-c55d-4e46-8bf6-a371ff08764f" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a7a607-3f09-4c0b-a6aa-2e7bc732ad2c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:33 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.525s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:33 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Deleted volume successfully. Jul 21 17:27:33 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f Jul 21 17:27:33 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-dfcbefd0-43df-48e3-8bd2-5ef9787691b8 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-6ff207e7-ea54-44f9-b9c9-05646f8ab9af-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:33 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f" returned: 0 in 0.758s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:33 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f Jul 21 17:27:33 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:34 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c73b834d-c55d-4e46-8bf6-a371ff08764f" returned: 0 in 0.534s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-quobyte-c73b834d-c55d-4e46-8bf6-a371ff08764f" released by "delete_volume" :: held 1.358s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Created reservations ['e69f5c84-a675-49e4-9c94-3c0abffcdeb2', '503549a8-5465-4ac7-9ef7-30fcf39417ba', 'b6820121-241c-4c08-b713-b185f3bcec1d', 'cc1ebbe1-8575-46a5-a6dc-165c86243519'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:34 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:34 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:34 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.606s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:34 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:34 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Deleted volume successfully. Jul 21 17:27:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2dc5a11a-0c41-4522-a66d-5c368a790fa2 tempest-CinderUnicodeTest-713574760 None] Lock "cinder-c73b834d-c55d-4e46-8bf6-a371ff08764f-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Flow 'volume_create_manager' (405076f3-58ba-44e7-88c3-e11519e71596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930a2dfc-0dd9-4aeb-9c71-a4914a368c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930a2dfc-0dd9-4aeb-9c71-a4914a368c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436397754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcff98da-b356-4b73-941d-084432c9796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fa617f2a0b46c79557e5ea2e2f6f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:39Z,use_quota=True,user_id='7083cc1b7a954fc89c3783daa603d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0f2656-9f7b-4bd6-b1e3-7c11ffc23b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0f2656-9f7b-4bd6-b1e3-7c11ffc23b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371df3d4-84e3-4e80-80f1-2a7c4ff2ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371df3d4-84e3-4e80-80f1-2a7c4ff2ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcff98da-b356-4b73-941d-084432c9796d', 'volume_name': 'volume-dcff98da-b356-4b73-941d-084432c9796d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78efaca3-ad87-45c3-8f6f-dc56e6d9a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78efaca3-ad87-45c3-8f6f-dc56e6d9a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217871fa-1e44-4f5d-a9d7-90ab897fcee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:38 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Volume dcff98da-b356-4b73-941d-084432c9796d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcff98da-b356-4b73-941d-084432c9796d', 'volume_size': 1} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436397754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcff98da-b356-4b73-941d-084432c9796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fa617f2a0b46c79557e5ea2e2f6f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:39Z,use_quota=True,user_id='7083cc1b7a954fc89c3783daa603d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Creating volume dcff98da-b356-4b73-941d-084432c9796d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:38 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:38 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d 1073741824 Jul 21 17:27:38 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:39 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d 1073741824" returned: 0 in 0.857s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:39 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d Jul 21 17:27:39 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:40 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d" returned: 0 in 0.434s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217871fa-1e44-4f5d-a9d7-90ab897fcee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcff98da-b356-4b73-941d-084432c9796d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e75ccd3-95fc-40df-9cc4-87295cbc50af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:40 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Volume volume-dcff98da-b356-4b73-941d-084432c9796d (dcff98da-b356-4b73-941d-084432c9796d): created successfully Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e75ccd3-95fc-40df-9cc4-87295cbc50af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Flow 'volume_create_manager' (405076f3-58ba-44e7-88c3-e11519e71596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8678eb64-3537-4ace-a757-5496fbd76976 tempest-ProjectReaderTests-1789326446 None] Created volume successfully. Jul 21 17:27:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "cinder-dcff98da-b356-4b73-941d-084432c9796d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-dcff98da-b356-4b73-941d-084432c9796d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "cinder-quobyte-dcff98da-b356-4b73-941d-084432c9796d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-quobyte-dcff98da-b356-4b73-941d-084432c9796d" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[154cb848-370d-4238-9645-f3833f83e369]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:41 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d Jul 21 17:27:41 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:42 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:42 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:42 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d" returned: 0 in 0.750s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:42 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d Jul 21 17:27:42 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:42 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.468s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:27:42 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-dcff98da-b356-4b73-941d-084432c9796d" returned: 0 in 0.328s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-quobyte-dcff98da-b356-4b73-941d-084432c9796d" released by "delete_volume" :: held 1.154s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:42 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Created reservations ['632690cd-aeb7-497d-836a-dc6add2f3071', '1fc9cf9d-c3b9-413c-87b1-f046461cfb02', 'f7ab457c-e418-406e-976b-759d1e088bbc', '6f72c2be-bd97-4e28-a494-2fcea0cfd223'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:43 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:43 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:43 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.461s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Deleted volume successfully. Jul 21 17:27:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-37f9301e-25bf-4454-a728-72b8bbfab3f4 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-dcff98da-b356-4b73-941d-084432c9796d-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Flow 'volume_create_manager' (c0660192-ee43-4741-955a-3710e7861600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c0c20f-9593-4279-ad92-5862ef32f280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c0c20f-9593-4279-ad92-5862ef32f280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647978635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8290c7d5-5137-4d66-a239-89911d259bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fa617f2a0b46c79557e5ea2e2f6f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:45Z,use_quota=True,user_id='7083cc1b7a954fc89c3783daa603d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6134963-b92d-4698-8eb6-c9163d4dccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6134963-b92d-4698-8eb6-c9163d4dccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21f9c63-c71d-42f7-84a5-45cd6509964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21f9c63-c71d-42f7-84a5-45cd6509964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8290c7d5-5137-4d66-a239-89911d259bb3', 'volume_name': 'volume-8290c7d5-5137-4d66-a239-89911d259bb3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4c9699-faca-454a-a71b-4d72748bd9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4c9699-faca-454a-a71b-4d72748bd9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779cf965-5814-4934-b8b9-bae2d6f25aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:44 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Volume 8290c7d5-5137-4d66-a239-89911d259bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8290c7d5-5137-4d66-a239-89911d259bb3', 'volume_size': 1} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647978635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8290c7d5-5137-4d66-a239-89911d259bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fa617f2a0b46c79557e5ea2e2f6f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:45Z,use_quota=True,user_id='7083cc1b7a954fc89c3783daa603d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Creating volume 8290c7d5-5137-4d66-a239-89911d259bb3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:44 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:44 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 1073741824 Jul 21 17:27:44 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:45 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 1073741824" returned: 0 in 0.571s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:45 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 Jul 21 17:27:45 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:45 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3" returned: 0 in 0.329s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779cf965-5814-4934-b8b9-bae2d6f25aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8290c7d5-5137-4d66-a239-89911d259bb3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72bf863-fdf2-41a3-bf1c-3ca57f8f78e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:45 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Volume volume-8290c7d5-5137-4d66-a239-89911d259bb3 (8290c7d5-5137-4d66-a239-89911d259bb3): created successfully Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72bf863-fdf2-41a3-bf1c-3ca57f8f78e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Flow 'volume_create_manager' (c0660192-ee43-4741-955a-3710e7861600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-52fed8cc-47ca-4f16-a123-c471c0a2a026 tempest-ProjectReaderTests-1789326446 None] Created volume successfully. Jul 21 17:27:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "cinder-8290c7d5-5137-4d66-a239-89911d259bb3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-8290c7d5-5137-4d66-a239-89911d259bb3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "cinder-quobyte-8290c7d5-5137-4d66-a239-89911d259bb3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-quobyte-8290c7d5-5137-4d66-a239-89911d259bb3" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fd488-2599-4a8a-aea9-8aaf5916210e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:47 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 Jul 21 17:27:47 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:47 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3" returned: 0 in 0.514s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:47 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3 Jul 21 17:27:47 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:47 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8290c7d5-5137-4d66-a239-89911d259bb3" returned: 0 in 0.306s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-quobyte-8290c7d5-5137-4d66-a239-89911d259bb3" released by "delete_volume" :: held 0.892s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Created reservations ['7f6529b8-548e-47dd-910e-b289e36302d1', 'a453eb15-fcfd-4f25-aef4-b482f16ad8d8', 'f23cef6f-a703-469d-8528-d73d8bf6459e', 'ba0465ca-f8f4-4f19-974f-1f6c3a8cb7d8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:48 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:27:48 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:48 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:27:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Deleted volume successfully. Jul 21 17:27:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4f5e2b77-f258-4e63-87a9-236d8b1b8eb5 tempest-ProjectReaderTests-1789326446 None] Lock "cinder-8290c7d5-5137-4d66-a239-89911d259bb3-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Flow 'volume_create_manager' (75ce450b-6f08-4c1f-a1e8-e8a59c3f77d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97e7b4d-af91-4805-b9e4-91ce392134f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97e7b4d-af91-4805-b9e4-91ce392134f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-529541720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abff23e4-f34f-42a8-926d-ccdaa1ecc206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee1b45c4ba145a1a36572234dabf733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:54Z,use_quota=True,user_id='f40977ab449247348ee44b1ea2f86c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28228eb9-4ad5-4d30-8d2d-0e63ab47164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28228eb9-4ad5-4d30-8d2d-0e63ab47164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9600f4ca-6176-4a4b-bc50-69696c5bbdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9600f4ca-6176-4a4b-bc50-69696c5bbdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abff23e4-f34f-42a8-926d-ccdaa1ecc206', 'volume_name': 'volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96d9d2b-0a7c-46da-8581-e13aa71ddc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96d9d2b-0a7c-46da-8581-e13aa71ddc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c17540-3f81-4e90-840d-5d7b07131dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Volume abff23e4-f34f-42a8-926d-ccdaa1ecc206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206', 'volume_size': 1} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-529541720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abff23e4-f34f-42a8-926d-ccdaa1ecc206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee1b45c4ba145a1a36572234dabf733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:54Z,use_quota=True,user_id='f40977ab449247348ee44b1ea2f86c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Creating volume abff23e4-f34f-42a8-926d-ccdaa1ecc206 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:54 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:54 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 1073741824 Jul 21 17:27:54 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Flow 'volume_create_manager' (897497c4-806a-4db8-9c93-2e337e094076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32b1f5e-91cb-4eb0-a216-5bcb4b2229bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32b1f5e-91cb-4eb0-a216-5bcb4b2229bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1295692625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de32531-6df7-4ed9-9fd9-c5d87a049cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee1b45c4ba145a1a36572234dabf733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:55Z,use_quota=True,user_id='f40977ab449247348ee44b1ea2f86c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708ab231-f254-4b0b-bd35-30fe9314c58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708ab231-f254-4b0b-bd35-30fe9314c58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0143d8e-20b6-4ea6-8405-320b6087e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0143d8e-20b6-4ea6-8405-320b6087e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de32531-6df7-4ed9-9fd9-c5d87a049cce', 'volume_name': 'volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa65932-80e8-4eeb-9833-c63757c19c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa65932-80e8-4eeb-9833-c63757c19c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f8b7ef-5fbb-4b00-9d35-fbbc8927acfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Volume 3de32531-6df7-4ed9-9fd9-c5d87a049cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce', 'volume_size': 1} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:55 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 1073741824" returned: 0 in 0.757s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:55 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 Jul 21 17:27:55 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:55 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1295692625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de32531-6df7-4ed9-9fd9-c5d87a049cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee1b45c4ba145a1a36572234dabf733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:27:55Z,use_quota=True,user_id='f40977ab449247348ee44b1ea2f86c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Creating volume 3de32531-6df7-4ed9-9fd9-c5d87a049cce {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:27:55 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c17540-3f81-4e90-840d-5d7b07131dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692784d4-c282-43b6-b210-81fb323d5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:55 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce 1073741824 Jul 21 17:27:55 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Volume volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 (abff23e4-f34f-42a8-926d-ccdaa1ecc206): created successfully Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692784d4-c282-43b6-b210-81fb323d5fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Flow 'volume_create_manager' (75ce450b-6f08-4c1f-a1e8-e8a59c3f77d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-295ccbcc-216f-4799-a264-d05cc593e8ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Created volume successfully. Jul 21 17:27:56 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce 1073741824" returned: 0 in 0.607s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:27:56 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce Jul 21 17:27:56 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:27:56 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f8b7ef-5fbb-4b00-9d35-fbbc8927acfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9574ccf5-d471-42b8-8d0b-94a792359c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:27:56 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Volume volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce (3de32531-6df7-4ed9-9fd9-c5d87a049cce): created successfully Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9574ccf5-d471-42b8-8d0b-94a792359c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:27:56 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Flow 'volume_create_manager' (897497c4-806a-4db8-9c93-2e337e094076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:27:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9e7aa5cd-023c-49eb-aa35-4de4a2ba1a5b tempest-TestServerVolumeAttachmentScenario-858736554 None] Created volume successfully. Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Flow 'volume_create_manager' (4fa66ea3-80ff-45f3-9871-d9cf7085eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7076a2d1-8ccc-4cff-b57c-c02d93af762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7076a2d1-8ccc-4cff-b57c-c02d93af762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-428229476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6e1c30-8824-4494-8a08-ab7456132bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6ecf1ad2c54566a79794217352bf93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:28:03Z,use_quota=True,user_id='34193dbc4b4b4fc5a80b7aa083ae4ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb016cf6-de79-4c95-9f63-fb650914cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb016cf6-de79-4c95-9f63-fb650914cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27add36-39f5-42f5-9a04-395832e9ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27add36-39f5-42f5-9a04-395832e9ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6e1c30-8824-4494-8a08-ab7456132bdc', 'volume_name': 'volume-6f6e1c30-8824-4494-8a08-ab7456132bdc', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8dfdd3-5e29-4ee3-bc83-df7cd66db3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8dfdd3-5e29-4ee3-bc83-df7cd66db3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8289c0d-c27f-4d69-a027-0a272e355ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Volume 6f6e1c30-8824-4494-8a08-ab7456132bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6e1c30-8824-4494-8a08-ab7456132bdc', 'volume_size': 1} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-428229476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6e1c30-8824-4494-8a08-ab7456132bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6ecf1ad2c54566a79794217352bf93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:28:03Z,use_quota=True,user_id='34193dbc4b4b4fc5a80b7aa083ae4ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Creating volume 6f6e1c30-8824-4494-8a08-ab7456132bdc {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:28:03 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:03 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc 1073741824 Jul 21 17:28:03 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:03 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc 1073741824" returned: 0 in 0.589s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:04 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc Jul 21 17:28:04 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:04 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8289c0d-c27f-4d69-a027-0a272e355ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6e1c30-8824-4494-8a08-ab7456132bdc', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc9cd60-23ec-43b3-a657-d822c86c1c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:04 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Volume volume-6f6e1c30-8824-4494-8a08-ab7456132bdc (6f6e1c30-8824-4494-8a08-ab7456132bdc): created successfully Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc9cd60-23ec-43b3-a657-d822c86c1c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Flow 'volume_create_manager' (4fa66ea3-80ff-45f3-9871-d9cf7085eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:28:04 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1cc3f783-6b5d-46dc-8af5-6c7509db5daa tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Created volume successfully. Jul 21 17:28:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-6766ae44-cb64-4e15-9949-ee69eeb61f8a req-1bb12820-e2fc-47e4-b317-9d3f4a395392 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-6766ae44-cb64-4e15-9949-ee69eeb61f8a req-1bb12820-e2fc-47e4-b317-9d3f4a395392 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-6766ae44-cb64-4e15-9949-ee69eeb61f8a req-1bb12820-e2fc-47e4-b317-9d3f4a395392 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:06 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-6766ae44-cb64-4e15-9949-ee69eeb61f8a req-1bb12820-e2fc-47e4-b317-9d3f4a395392 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-6f6e1c30-8824-4494-8a08-ab7456132bdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e725f1bb-e2b7-42fe-8d2c-8457c840dc95', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:28:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-6766ae44-cb64-4e15-9949-ee69eeb61f8a req-1bb12820-e2fc-47e4-b317-9d3f4a395392 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] attachment_update completed successfully. Jul 21 17:28:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-d7cf23a9-fa92-450d-8ae3-80d7a68b2713 req-d6d1beb3-c720-4039-96f3-7ac958213d22 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Terminate volume connection completed successfully. Jul 21 17:28:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-d7cf23a9-fa92-450d-8ae3-80d7a68b2713 req-d6d1beb3-c720-4039-96f3-7ac958213d22 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Deleting attachment e725f1bb-e2b7-42fe-8d2c-8457c840dc95. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:28:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Acquiring lock "cinder-6f6e1c30-8824-4494-8a08-ab7456132bdc-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "cinder-6f6e1c30-8824-4494-8a08-ab7456132bdc-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Acquiring lock "cinder-quobyte-6f6e1c30-8824-4494-8a08-ab7456132bdc" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "cinder-quobyte-6f6e1c30-8824-4494-8a08-ab7456132bdc" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:11 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5087ff-6097-4ea4-a1ba-158135e43141]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:11 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc Jul 21 17:28:11 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:12 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc" returned: 0 in 0.459s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:12 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc Jul 21 17:28:12 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:12 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6f6e1c30-8824-4494-8a08-ab7456132bdc" returned: 0 in 0.295s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "cinder-quobyte-6f6e1c30-8824-4494-8a08-ab7456132bdc" released by "delete_volume" :: held 0.822s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=172,cinder:SELECT=110,cinder:DELETE=9,cinder:INSERT=36 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Created reservations ['11cb52b2-4c92-4765-b6f6-52b48984162a', '51335195-2492-4776-84e9-f87b839305a2', '356dcae4-5248-4afb-9b9c-e4106bedaf00', 'ceef801a-67fd-49c6-a71b-1cbca3960cb9'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:12 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:28:12 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:13 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.450s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:13 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:28:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Deleted volume successfully. Jul 21 17:28:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7d855a33-f9d7-452f-9971-ad506e4b1b05 tempest-TestServerVolumeAttachScenarioOldVersion-531918201 None] Lock "cinder-6f6e1c30-8824-4494-8a08-ab7456132bdc-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Flow 'volume_create_manager' (b819ee49-47eb-4f90-8f98-3978d23bfb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995adfc1-271b-4015-847d-dff7ac5a0feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=134,cinder:SELECT=116,cinder:INSERT=40,cinder:DELETE=17 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995adfc1-271b-4015-847d-dff7ac5a0feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1209167660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629b36f4-1e8f-4885-9aec-20c6ed10d935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff255cc80f6448b81fc75d1a3a793d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:28:18Z,use_quota=True,user_id='b10b736884b84e0b834a2b0906125ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ac0241-5970-4b33-a4af-a41392095bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ac0241-5970-4b33-a4af-a41392095bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508467b5-9519-44c3-900a-02ff8b64fccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508467b5-9519-44c3-900a-02ff8b64fccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629b36f4-1e8f-4885-9aec-20c6ed10d935', 'volume_name': 'volume-629b36f4-1e8f-4885-9aec-20c6ed10d935', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f56e6-f16f-474d-8ca6-41900fd81b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f56e6-f16f-474d-8ca6-41900fd81b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9e66bb-4a00-4769-ba8e-efaa0a6b7632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Volume 629b36f4-1e8f-4885-9aec-20c6ed10d935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629b36f4-1e8f-4885-9aec-20c6ed10d935', 'volume_size': 1} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1209167660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629b36f4-1e8f-4885-9aec-20c6ed10d935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff255cc80f6448b81fc75d1a3a793d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:28:18Z,use_quota=True,user_id='b10b736884b84e0b834a2b0906125ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Creating volume 629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:28:17 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:28:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:17 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 1073741824 Jul 21 17:28:17 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:18 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 1073741824" returned: 0 in 0.489s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:18 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:18 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:18 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9e66bb-4a00-4769-ba8e-efaa0a6b7632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629b36f4-1e8f-4885-9aec-20c6ed10d935', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215c043a-0f38-42b2-a848-147c353f9e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Volume volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 (629b36f4-1e8f-4885-9aec-20c6ed10d935): created successfully Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215c043a-0f38-42b2-a848-147c353f9e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Flow 'volume_create_manager' (b819ee49-47eb-4f90-8f98-3978d23bfb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:28:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-69920071-44ad-4f2a-aa1c-724fcd5cc590 tempest-SnapshotDependencyTests-31909113 None] Created volume successfully. Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Creating offline snapshot 78dab695-5dba-4400-bc7a-57e934e0bb3a of volume 629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d011cf8b-683c-4c83-a9ff-40b3c09369be]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:20 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:20 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:20 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:20 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a 1G Jul 21 17:28:20 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:20 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a 1G" returned: 0 in 0.469s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:20 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a Jul 21 17:28:20 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:21 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:21 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a is being set with open permissions: ugo+rw Jul 21 17:28:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:21 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a Jul 21 17:28:21 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:21 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a" returned: 0 in 0.282s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:21 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info Jul 21 17:28:21 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:21 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info" returned: 0 in 0.271s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:21 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info is being set with open permissions: ugo+rw Jul 21 17:28:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:21 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info Jul 21 17:28:21 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:22 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.info" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-18541e46-52e1-46de-8665-fc9d0e57c354 tempest-SnapshotDependencyTests-31909113 None] Create snapshot completed successfully Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Flow 'volume_create_manager' (3394b8af-f84b-4504-9b7b-0223d41038a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ddcb15-a887-4778-be0a-6d44db2cd32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ddcb15-a887-4778-be0a-6d44db2cd32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf96133-f932-4ee5-aa01-6da56edd4d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff255cc80f6448b81fc75d1a3a793d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78dab695-5dba-4400-bc7a-57e934e0bb3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:28:24Z,use_quota=True,user_id='b10b736884b84e0b834a2b0906125ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba704b14-e920-473b-97f0-f62be7863265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba704b14-e920-473b-97f0-f62be7863265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff509a10-5e1f-4da1-b3b1-3aff208ddea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff509a10-5e1f-4da1-b3b1-3aff208ddea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abf96133-f932-4ee5-aa01-6da56edd4d04', 'volume_name': 'volume-abf96133-f932-4ee5-aa01-6da56edd4d04', 'volume_size': 1, 'snapshot_id': '78dab695-5dba-4400-bc7a-57e934e0bb3a'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6497e14b-f826-413d-baed-6aef3f4c4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6497e14b-f826-413d-baed-6aef3f4c4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9458dfd1-c97e-43d4-bd0b-b1fd495ec334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Volume abf96133-f932-4ee5-aa01-6da56edd4d04: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abf96133-f932-4ee5-aa01-6da56edd4d04', 'volume_size': 1, 'snapshot_id': '78dab695-5dba-4400-bc7a-57e934e0bb3a'} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-quobyte-78dab695-5dba-4400-bc7a-57e934e0bb3a-abf96133-f932-4ee5-aa01-6da56edd4d04" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-78dab695-5dba-4400-bc7a-57e934e0bb3a-abf96133-f932-4ee5-aa01-6da56edd4d04" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Creating volume abf96133-f932-4ee5-aa01-6da56edd4d04 from snapshot 78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-quobyte-abf96133-f932-4ee5-aa01-6da56edd4d04" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-abf96133-f932-4ee5-aa01-6da56edd4d04" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] snapshot: 78dab695-5dba-4400-bc7a-57e934e0bb3a, volume: abf96133-f932-4ee5-aa01-6da56edd4d04, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e793d7-9573-4eb5-a165-f22707a3b639]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:24 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a Jul 21 17:28:24 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:24 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a" returned: 0 in 0.374s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-629b36f4-1e8f-4885-9aec-20c6ed10d935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b00cd9-515c-4dc0-acb9-c2f6876d71b8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:24 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:24 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:24 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:28:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:24 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 Jul 21 17:28:24 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:30 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04" returned: 0 in 5.559s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22592b7b-297d-4be2-a41a-ed170760b8b7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:30 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:30 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:30 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.627s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:30 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:28:30 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Converted 1024.00 MB image at 184.15 MB/s Jul 21 17:28:30 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 is being set with open permissions: ugo+rw Jul 21 17:28:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:30 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 Jul 21 17:28:30 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:31 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04" returned: 0 in 0.272s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-abf96133-f932-4ee5-aa01-6da56edd4d04" released by "_copy_volume_from_snapshot" :: held 7.348s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-78dab695-5dba-4400-bc7a-57e934e0bb3a-abf96133-f932-4ee5-aa01-6da56edd4d04" released by "_create_volume_from_snapshot" :: held 7.394s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.412s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9458dfd1-c97e-43d4-bd0b-b1fd495ec334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf96133-f932-4ee5-aa01-6da56edd4d04', 'volume_size': 1, 'snapshot_id': '78dab695-5dba-4400-bc7a-57e934e0bb3a'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a5e5e8-0868-4997-b3fa-42a838d1e9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:28:31 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Volume volume-abf96133-f932-4ee5-aa01-6da56edd4d04 (abf96133-f932-4ee5-aa01-6da56edd4d04): created successfully Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a5e5e8-0868-4997-b3fa-42a838d1e9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Flow 'volume_create_manager' (3394b8af-f84b-4504-9b7b-0223d41038a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:28:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-85bfa3e5-9096-4095-8b47-bb78a18ab4c3 tempest-SnapshotDependencyTests-31909113 None] Created volume successfully. Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-78dab695-5dba-4400-bc7a-57e934e0bb3a-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-78dab695-5dba-4400-bc7a-57e934e0bb3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-quobyte-629b36f4-1e8f-4885-9aec-20c6ed10d935" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-629b36f4-1e8f-4885-9aec-20c6ed10d935" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-quobyte-78dab695-5dba-4400-bc7a-57e934e0bb3a" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-78dab695-5dba-4400-bc7a-57e934e0bb3a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Deleting offline snapshot 78dab695-5dba-4400-bc7a-57e934e0bb3a of volume 629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] snapshot_file for this snap is: volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba02ab-6a04-48a7-a41b-0a7b6ad88dee]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-5aa10608-a79f-4440-a873-484018d0fe22 req-1c123ada-6a14-43f7-9954-855564e2d1c0 tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-5aa10608-a79f-4440-a873-484018d0fe22 req-1c123ada-6a14-43f7-9954-855564e2d1c0 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-5aa10608-a79f-4440-a873-484018d0fe22 req-1c123ada-6a14-43f7-9954-855564e2d1c0 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:31 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-5aa10608-a79f-4440-a873-484018d0fe22 req-1c123ada-6a14-43f7-9954-855564e2d1c0 tempest-TestServerVolumeAttachmentScenario-858736554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf452348-a99c-4e76-bb0d-2924474e08a5', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:28:31 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a Jul 21 17:28:31 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-5aa10608-a79f-4440-a873-484018d0fe22 req-1c123ada-6a14-43f7-9954-855564e2d1c0 tempest-TestServerVolumeAttachmentScenario-858736554 None] attachment_update completed successfully. Jul 21 17:28:32 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a" returned: 0 in 0.415s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-629b36f4-1e8f-4885-9aec-20c6ed10d935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daa0a26-1c5c-4edd-86e7-bbeaec3293ee]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:32 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:32 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:32 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.459s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:32 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a Jul 21 17:28:32 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:32 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a" returned: 0 in 0.363s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:33 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a Jul 21 17:28:33 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:33 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935.78dab695-5dba-4400-bc7a-57e934e0bb3a" returned: 0 in 0.249s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-78dab695-5dba-4400-bc7a-57e934e0bb3a" released by "_delete_snapshot" :: held 1.609s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-629b36f4-1e8f-4885-9aec-20c6ed10d935" released by "delete_snapshot" :: held 1.637s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Created reservations ['a7a4725f-5666-4473-9a5c-4abc5f4e1695', 'ddcba6a4-9679-4566-9119-701fd38c52f2', '489bbea1-6b60-4c36-bfab-cd478154d5e5', 'c3699f2f-efa8-4679-b175-ece1c58238bc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:28:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Delete snapshot completed successfully. Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c425eebb-9590-4213-acef-fea260cb122b tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-78dab695-5dba-4400-bc7a-57e934e0bb3a-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-629b36f4-1e8f-4885-9aec-20c6ed10d935-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-629b36f4-1e8f-4885-9aec-20c6ed10d935-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-quobyte-629b36f4-1e8f-4885-9aec-20c6ed10d935" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-629b36f4-1e8f-4885-9aec-20c6ed10d935" acquired by "delete_volume" :: waited 0.031s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[41325dd3-8939-4c25-ac76-f6fd870ddce2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:34 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:34 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:34 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.430s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:34 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935 Jul 21 17:28:34 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:34 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-629b36f4-1e8f-4885-9aec-20c6ed10d935" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-629b36f4-1e8f-4885-9aec-20c6ed10d935" released by "delete_volume" :: held 0.808s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Created reservations ['a3777c89-a2a2-478a-8052-99cab8eed444', '5b7307ba-785a-4ac2-9bc5-89e71ad2dbf0', '51868039-fc0b-4a4a-8c12-dc4606b9336f', 'c6f325c7-1a6a-4e52-870e-d25c8fbf4e55'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:34 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:28:34 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-abf96133-f932-4ee5-aa01-6da56edd4d04-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:35 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-abf96133-f932-4ee5-aa01-6da56edd4d04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.306s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:28:35 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Deleted volume successfully. Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-58cea946-aba2-481c-abe8-6cb8da931f86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-629b36f4-1e8f-4885-9aec-20c6ed10d935-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "cinder-quobyte-abf96133-f932-4ee5-aa01-6da56edd4d04" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-abf96133-f932-4ee5-aa01-6da56edd4d04" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c6874-d2e3-47f0-9239-94cb7b0858b2]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:35 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 Jul 21 17:28:35 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:35 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04" returned: 0 in 0.426s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:35 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04 Jul 21 17:28:35 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:35 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abf96133-f932-4ee5-aa01-6da56edd4d04" returned: 0 in 0.272s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-quobyte-abf96133-f932-4ee5-aa01-6da56edd4d04" released by "delete_volume" :: held 0.755s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Created reservations ['1a469667-36f8-4cf8-8af4-a5f701a5ed4d', '3ee59e87-9d21-4681-8dd6-9f0e9bf31975', '1f291823-332f-4626-8ebe-0d87335c76b8', '6d0f2553-df8e-4ff4-9834-671b3df3eba6'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:36 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:28:36 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:36 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.348s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:28:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Deleted volume successfully. Jul 21 17:28:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-309045f4-2a06-40f4-b925-60d2154acd86 tempest-SnapshotDependencyTests-31909113 None] Lock "cinder-abf96133-f932-4ee5-aa01-6da56edd4d04-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-4b0bd7c7-52f5-4dcf-9e36-d298cd64a61f req-7c3a4939-f664-4797-af78-e10df0949122 tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-4b0bd7c7-52f5-4dcf-9e36-d298cd64a61f req-7c3a4939-f664-4797-af78-e10df0949122 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-4b0bd7c7-52f5-4dcf-9e36-d298cd64a61f req-7c3a4939-f664-4797-af78-e10df0949122 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:37 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-4b0bd7c7-52f5-4dcf-9e36-d298cd64a61f req-7c3a4939-f664-4797-af78-e10df0949122 tempest-TestServerVolumeAttachmentScenario-858736554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f22a4c87-4d9f-4d98-b529-9919c5f681ed', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:28:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-4b0bd7c7-52f5-4dcf-9e36-d298cd64a61f req-7c3a4939-f664-4797-af78-e10df0949122 tempest-TestServerVolumeAttachmentScenario-858736554 None] attachment_update completed successfully. Jul 21 17:28:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-bf8ac0f6-0cda-4608-bfbd-47d2483939e7 req-4b9a82c0-f3f7-4084-8c9e-c50c807cbedf tempest-TestServerVolumeAttachmentScenario-858736554 None] Terminate volume connection completed successfully. Jul 21 17:28:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-bf8ac0f6-0cda-4608-bfbd-47d2483939e7 req-4b9a82c0-f3f7-4084-8c9e-c50c807cbedf tempest-TestServerVolumeAttachmentScenario-858736554 None] Deleting attachment f22a4c87-4d9f-4d98-b529-9919c5f681ed. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:28:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-b7193e26-3f92-4116-86bc-a62a33c5ca84 req-20a2b054-54f6-45fa-83a9-58dc63709d9c tempest-TestServerVolumeAttachmentScenario-858736554 None] Terminate volume connection completed successfully. Jul 21 17:28:41 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-b7193e26-3f92-4116-86bc-a62a33c5ca84 req-20a2b054-54f6-45fa-83a9-58dc63709d9c tempest-TestServerVolumeAttachmentScenario-858736554 None] Deleting attachment bf452348-a99c-4e76-bb0d-2924474e08a5. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:42 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:28:42 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:42 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.419s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:28:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:28:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "cinder-3de32531-6df7-4ed9-9fd9-c5d87a049cce-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-3de32531-6df7-4ed9-9fd9-c5d87a049cce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "cinder-quobyte-3de32531-6df7-4ed9-9fd9-c5d87a049cce" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-quobyte-3de32531-6df7-4ed9-9fd9-c5d87a049cce" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c58bd70-78d6-42e8-8400-88e4912ae3ec]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:46 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce Jul 21 17:28:46 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:46 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:46 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce Jul 21 17:28:46 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:46 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3de32531-6df7-4ed9-9fd9-c5d87a049cce" returned: 0 in 0.245s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-quobyte-3de32531-6df7-4ed9-9fd9-c5d87a049cce" released by "delete_volume" :: held 0.672s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Created reservations ['a4c0d275-37ab-4244-b1c4-30ea96b1338a', '274810ad-6039-4afa-9cb4-d95770d7ddaa', '04a95bd7-9f04-4c40-8ede-8d3d86fbd507', '0415f07c-4673-45f1-9ffc-e9d5ecf81023'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:46 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:28:46 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:47 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:28:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Deleted volume successfully. Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e1876a02-4ff1-42c7-a1df-e6ef3a98a1ef tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-3de32531-6df7-4ed9-9fd9-c5d87a049cce-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "cinder-abff23e4-f34f-42a8-926d-ccdaa1ecc206-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-abff23e4-f34f-42a8-926d-ccdaa1ecc206-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "cinder-quobyte-abff23e4-f34f-42a8-926d-ccdaa1ecc206" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-quobyte-abff23e4-f34f-42a8-926d-ccdaa1ecc206" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec440ffa-dead-4bc4-9133-3680b44ff755]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:47 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 Jul 21 17:28:47 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:47 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206" returned: 0 in 0.348s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:47 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206 Jul 21 17:28:47 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:47 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-abff23e4-f34f-42a8-926d-ccdaa1ecc206" returned: 0 in 0.238s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-quobyte-abff23e4-f34f-42a8-926d-ccdaa1ecc206" released by "delete_volume" :: held 0.622s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Created reservations ['ceb4b3f3-3d95-4ec7-aaf5-99987dce163b', '2fd098e7-13ab-4d1b-a4b2-97a0f3ec34f8', '0a1a8464-93ed-4339-8fe3-d6bd3893db4f', '79b46a20-1db8-4e00-9db2-ce958d79ba5e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:28:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:28:47 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:28:47 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:28:48 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 21 17:28:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.235s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:28:48 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:28:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Deleted volume successfully. Jul 21 17:28:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-82d791f2-476b-4c1d-9fff-91efbd10ada7 tempest-TestServerVolumeAttachmentScenario-858736554 None] Lock "cinder-abff23e4-f34f-42a8-926d-ccdaa1ecc206-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:28:57 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=56,cinder:SELECT=46,cinder:DELETE=1,cinder:INSERT=9 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:28:58 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=51,cinder:INSERT=13,cinder:UPDATE=47,cinder:DELETE=6 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Flow 'volume_create_manager' (d765ba2a-6e30-47ab-9ec8-d951846d7a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f453d2f4-1972-4612-aa13-c3bebb82e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f453d2f4-1972-4612-aa13-c3bebb82e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1196497678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8783a76-bf37-4eac-a98d-645bfc4f106e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdb37cd3080425e86f3ad0a73264896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:29:20Z,use_quota=True,user_id='d44a7f74c6014ac6accf2515f2bff32d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b68af6-bdfc-4000-9349-6ce17b5dbea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b68af6-bdfc-4000-9349-6ce17b5dbea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007e5e38-b09d-4573-b708-82fb3f7010c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007e5e38-b09d-4573-b708-82fb3f7010c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8783a76-bf37-4eac-a98d-645bfc4f106e', 'volume_name': 'volume-b8783a76-bf37-4eac-a98d-645bfc4f106e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad389570-cddb-496c-81b8-e46141473a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad389570-cddb-496c-81b8-e46141473a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e535e4-bcb8-42d2-a821-dacab15f8d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:29:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Volume b8783a76-bf37-4eac-a98d-645bfc4f106e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8783a76-bf37-4eac-a98d-645bfc4f106e', 'volume_size': 1} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1196497678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8783a76-bf37-4eac-a98d-645bfc4f106e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdb37cd3080425e86f3ad0a73264896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:29:20Z,use_quota=True,user_id='d44a7f74c6014ac6accf2515f2bff32d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Creating volume b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:29:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:29:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:19 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e 1073741824 Jul 21 17:29:19 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:20 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e 1073741824" returned: 0 in 0.457s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:20 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:29:20 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:20 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.264s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e535e4-bcb8-42d2-a821-dacab15f8d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8783a76-bf37-4eac-a98d-645bfc4f106e', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7107a3bd-b380-4d44-83c0-0fcfa635d194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:29:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Volume volume-b8783a76-bf37-4eac-a98d-645bfc4f106e (b8783a76-bf37-4eac-a98d-645bfc4f106e): created successfully Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7107a3bd-b380-4d44-83c0-0fcfa635d194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:29:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Flow 'volume_create_manager' (d765ba2a-6e30-47ab-9ec8-d951846d7a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:29:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-07e1c370-181c-4c73-a9b2-8750f7761796 tempest-TestStampPattern-884106218 None] Created volume successfully. Jul 21 17:29:30 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:29:30 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:42 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:29:42 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:42 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.243s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:29:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:29:49 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:29:49 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:29:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-eb7bb456-1d43-448b-b8c9-dff55228910d req-4a139c18-4076-4e88-a028-f073828358f5 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:29:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-eb7bb456-1d43-448b-b8c9-dff55228910d req-4a139c18-4076-4e88-a028-f073828358f5 tempest-TestStampPattern-884106218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:29:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-eb7bb456-1d43-448b-b8c9-dff55228910d req-4a139c18-4076-4e88-a028-f073828358f5 tempest-TestStampPattern-884106218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:29:49 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-eb7bb456-1d43-448b-b8c9-dff55228910d req-4a139c18-4076-4e88-a028-f073828358f5 tempest-TestStampPattern-884106218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-b8783a76-bf37-4eac-a98d-645bfc4f106e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b0e4535-531b-49c1-8f50-05ecc92bdad2', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:29:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-eb7bb456-1d43-448b-b8c9-dff55228910d req-4a139c18-4076-4e88-a028-f073828358f5 tempest-TestStampPattern-884106218 None] attachment_update completed successfully. Jul 21 17:29:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-89192bd5-7a45-4e96-bed9-9888e99379a3 req-d5da1a45-7ffe-4747-88c6-937a175aa51f tempest-TestStampPattern-884106218 None] Terminate volume connection completed successfully. Jul 21 17:29:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-89192bd5-7a45-4e96-bed9-9888e99379a3 req-d5da1a45-7ffe-4747-88c6-937a175aa51f tempest-TestStampPattern-884106218 None] Deleting attachment 1b0e4535-531b-49c1-8f50-05ecc92bdad2. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Creating offline snapshot bde1a49d-ed66-4d66-a1e2-03f2b6284bce of volume b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc4bf2-dad7-45fb-8d67-ed2e8058866a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:54 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:29:54 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:54 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.345s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:54 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce 1G Jul 21 17:29:54 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:55 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce 1G" returned: 0 in 0.379s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8783a76-bf37-4eac-a98d-645bfc4f106e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:55 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8783a76-bf37-4eac-a98d-645bfc4f106e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce Jul 21 17:29:55 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:55 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8783a76-bf37-4eac-a98d-645bfc4f106e -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce" returned: 0 in 0.278s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:55 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce is being set with open permissions: ugo+rw Jul 21 17:29:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:55 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce Jul 21 17:29:55 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:55 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce" returned: 0 in 0.230s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:55 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info Jul 21 17:29:55 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:56 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info" returned: 0 in 0.235s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:56 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info is being set with open permissions: ugo+rw Jul 21 17:29:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:29:56 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info Jul 21 17:29:56 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:29:56 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 21 17:29:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.info" returned: 0 in 0.235s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:29:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.782s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:29:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6e3e9a13-6bba-435b-b74f-ea36484bdc67 tempest-TestStampPattern-884106218 None] Create snapshot completed successfully Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Flow 'volume_create_manager' (747408ef-eadd-460a-a0af-ab5c75a7f06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ea7d8a-b644-4ee7-b0b5-88c9d16b8d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ea7d8a-b644-4ee7-b0b5-88c9d16b8d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2039440855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71056bae-e344-45e6-bfec-55469749ab72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdb37cd3080425e86f3ad0a73264896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bde1a49d-ed66-4d66-a1e2-03f2b6284bce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:30:03Z,use_quota=True,user_id='d44a7f74c6014ac6accf2515f2bff32d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c12d819-fece-49b2-a042-dded31e9ca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c12d819-fece-49b2-a042-dded31e9ca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137afc81-4705-4d64-9fc8-3760c30c3d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137afc81-4705-4d64-9fc8-3760c30c3d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '71056bae-e344-45e6-bfec-55469749ab72', 'volume_name': 'volume-71056bae-e344-45e6-bfec-55469749ab72', 'volume_size': 1, 'snapshot_id': 'bde1a49d-ed66-4d66-a1e2-03f2b6284bce'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871d7799-e5ae-484a-b67b-44224e56aabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871d7799-e5ae-484a-b67b-44224e56aabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f7a5a6-3d02-4387-8d49-9d0d1473ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:30:03 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Volume 71056bae-e344-45e6-bfec-55469749ab72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-71056bae-e344-45e6-bfec-55469749ab72', 'volume_size': 1, 'snapshot_id': 'bde1a49d-ed66-4d66-a1e2-03f2b6284bce'} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-quobyte-bde1a49d-ed66-4d66-a1e2-03f2b6284bce-71056bae-e344-45e6-bfec-55469749ab72" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-bde1a49d-ed66-4d66-a1e2-03f2b6284bce-71056bae-e344-45e6-bfec-55469749ab72" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Creating volume 71056bae-e344-45e6-bfec-55469749ab72 from snapshot bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-quobyte-71056bae-e344-45e6-bfec-55469749ab72" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-71056bae-e344-45e6-bfec-55469749ab72" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] snapshot: bde1a49d-ed66-4d66-a1e2-03f2b6284bce, volume: 71056bae-e344-45e6-bfec-55469749ab72, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2f0c2-8bfa-4d66-8a1e-c9a045ea7e8d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:03 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce Jul 21 17:30:03 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:03 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce" returned: 0 in 0.396s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8783a76-bf37-4eac-a98d-645bfc4f106e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d7d3c-bd8b-49b4-a73c-3bd18a281a66]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:30:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:03 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:30:03 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:04 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:04 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:30:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:04 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 Jul 21 17:30:04 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:09 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72" returned: 0 in 5.529s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2805f-182f-49e7-9193-bf8d1e4de2cc]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:30:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:09 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:30:09 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:10 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.632s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:30:10 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Converted 1024.00 MB image at 185.16 MB/s Jul 21 17:30:10 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 is being set with open permissions: ugo+rw Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:10 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 Jul 21 17:30:10 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:10 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72" returned: 0 in 0.262s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-71056bae-e344-45e6-bfec-55469749ab72" released by "_copy_volume_from_snapshot" :: held 7.329s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-bde1a49d-ed66-4d66-a1e2-03f2b6284bce-71056bae-e344-45e6-bfec-55469749ab72" released by "_create_volume_from_snapshot" :: held 7.382s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.397s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f7a5a6-3d02-4387-8d49-9d0d1473ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71056bae-e344-45e6-bfec-55469749ab72', 'volume_size': 1, 'snapshot_id': 'bde1a49d-ed66-4d66-a1e2-03f2b6284bce'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b15b57-f40e-4b83-9092-1efbc92abc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:30:10 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Volume volume-71056bae-e344-45e6-bfec-55469749ab72 (71056bae-e344-45e6-bfec-55469749ab72): created successfully Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b15b57-f40e-4b83-9092-1efbc92abc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:30:10 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Flow 'volume_create_manager' (747408ef-eadd-460a-a0af-ab5c75a7f06b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:30:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4ff8ce50-1e1b-4e7e-a8eb-db88d60882e3 tempest-TestStampPattern-884106218 None] Created volume successfully. Jul 21 17:30:20 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:30:20 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:42 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:30:42 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:42 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:30:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5861410-ef1e-45ad-8f2c-36139d440cfd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:51 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 Jul 21 17:30:51 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:51 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72" returned: 0 in 0.345s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.369s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:30:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6', 'name': 'volume-71056bae-e344-45e6-bfec-55469749ab72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f12b5c44-fc08-4a54-947a-48053d57a9ac', 'enforce_multipath': True} {{(pid=87591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 17:30:51 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-fd475eaa-fa26-4320-9b76-4982e9810500 req-bbe13fb3-2ebf-4e68-bda7-e44ad2ad64eb tempest-TestStampPattern-884106218 None] attachment_update completed successfully. Jul 21 17:30:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [req-699bc769-146c-4082-980a-f229af9e4c58 req-ade80fe8-15af-4272-b746-d85a4c43a058 tempest-TestStampPattern-884106218 None] Terminate volume connection completed successfully. Jul 21 17:30:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [req-699bc769-146c-4082-980a-f229af9e4c58 req-ade80fe8-15af-4272-b746-d85a4c43a058 tempest-TestStampPattern-884106218 None] Deleting attachment f12b5c44-fc08-4a54-947a-48053d57a9ac. {{(pid=87591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-71056bae-e344-45e6-bfec-55469749ab72-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Lock "cinder-71056bae-e344-45e6-bfec-55469749ab72-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-quobyte-71056bae-e344-45e6-bfec-55469749ab72" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-71056bae-e344-45e6-bfec-55469749ab72" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf8a773-7960-4c03-b86c-434f1b8166c6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:59 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 Jul 21 17:30:59 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:59 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72" returned: 0 in 0.361s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:59 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72 Jul 21 17:30:59 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:30:59 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-71056bae-e344-45e6-bfec-55469749ab72" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-71056bae-e344-45e6-bfec-55469749ab72" released by "delete_volume" :: held 0.647s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Created reservations ['ab3fe2da-d852-414f-95f0-14bc348ecf8c', 'ccf6ff37-05ea-4ed4-a0a4-9d729497c290', 'b6b9f85a-f76d-41de-9e6c-75224e37bf8c', '19412a88-c4ce-4a18-b410-ebcd452957f7'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:30:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:30:59 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:30:59 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:00 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Deleted volume successfully. Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d3445f50-30d9-47b7-9151-468db0e64c9e tempest-TestStampPattern-884106218 None] Lock "cinder-71056bae-e344-45e6-bfec-55469749ab72-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-bde1a49d-ed66-4d66-a1e2-03f2b6284bce-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Lock "cinder-bde1a49d-ed66-4d66-a1e2-03f2b6284bce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-quobyte-b8783a76-bf37-4eac-a98d-645bfc4f106e" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-b8783a76-bf37-4eac-a98d-645bfc4f106e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-quobyte-bde1a49d-ed66-4d66-a1e2-03f2b6284bce" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-bde1a49d-ed66-4d66-a1e2-03f2b6284bce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Deleting offline snapshot bde1a49d-ed66-4d66-a1e2-03f2b6284bce of volume b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] snapshot_file for this snap is: volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99897729-a9e4-47d1-8c64-ec710d0cc2d1]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:00 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce Jul 21 17:31:00 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:00 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce" returned: 0 in 0.350s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8783a76-bf37-4eac-a98d-645bfc4f106e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5de6c8-523c-40d3-95d0-7b3375db01f6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:01 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:31:01 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:01 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.347s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:01 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce Jul 21 17:31:01 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:01 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce" returned: 0 in 0.336s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:01 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce Jul 21 17:31:01 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:01 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e.bde1a49d-ed66-4d66-a1e2-03f2b6284bce" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-bde1a49d-ed66-4d66-a1e2-03f2b6284bce" released by "_delete_snapshot" :: held 1.379s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-b8783a76-bf37-4eac-a98d-645bfc4f106e" released by "delete_snapshot" :: held 1.403s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Created reservations ['25bb1e16-d208-4fad-a408-914f8295459e', '2d7582ae-ce1b-440a-94a7-ccfa9e425713', '654cd419-5151-40b8-a66e-35801bcb04f6', '4c5ec12a-f36c-4119-81dd-a698aa994b02'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Delete snapshot completed successfully. Jul 21 17:31:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-35bd5c2c-0379-4275-bfa6-961f5fa7fe5b tempest-TestStampPattern-884106218 None] Lock "cinder-bde1a49d-ed66-4d66-a1e2-03f2b6284bce-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-b8783a76-bf37-4eac-a98d-645bfc4f106e-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Lock "cinder-b8783a76-bf37-4eac-a98d-645bfc4f106e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Acquiring lock "cinder-quobyte-b8783a76-bf37-4eac-a98d-645bfc4f106e" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-b8783a76-bf37-4eac-a98d-645bfc4f106e" acquired by "delete_volume" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16db67-6724-49cd-8f50-77dce98ede9d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:06 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:31:06 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:06 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.351s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:06 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e Jul 21 17:31:06 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:06 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b8783a76-bf37-4eac-a98d-645bfc4f106e" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Lock "cinder-quobyte-b8783a76-bf37-4eac-a98d-645bfc4f106e" released by "delete_volume" :: held 0.646s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Created reservations ['1b970fdc-7814-4bb7-b680-089955cf552b', '7786b869-bca6-4ca7-9bc2-46016e406ac8', '8b524835-2304-4213-972f-0b0c5a54fe37', '62ebe1e0-59d6-4d17-817a-630db1a61409'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:06 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:06 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:07 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:07 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:07 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Deleted volume successfully. Jul 21 17:31:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c778ceec-0346-4136-a592-112e1b4b2c8a tempest-TestStampPattern-884106218 None] Lock "cinder-b8783a76-bf37-4eac-a98d-645bfc4f106e-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=21 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (9b2dda20-5fd6-4bc8-bb7e-5fe979dfeaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3ebbac-7841-4a4a-994e-16ba2ea1eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3ebbac-7841-4a4a-994e-16ba2ea1eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419270765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb856455-3120-42dc-8f26-aad2b4b5dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:17Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d4aed1-830a-4db9-b5d5-eacc2e67c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d4aed1-830a-4db9-b5d5-eacc2e67c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0ea796-783d-45e2-a7f8-49f9d805ee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0ea796-783d-45e2-a7f8-49f9d805ee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb856455-3120-42dc-8f26-aad2b4b5dcf0', 'volume_name': 'volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dc1759-1e8d-4d58-a7d4-a1f8d084edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dc1759-1e8d-4d58-a7d4-a1f8d084edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053f822c-b11a-4abd-a0b9-09d0db3940b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Volume bb856455-3120-42dc-8f26-aad2b4b5dcf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0', 'volume_size': 1} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419270765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb856455-3120-42dc-8f26-aad2b4b5dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:17Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Creating volume bb856455-3120-42dc-8f26-aad2b4b5dcf0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:17 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 1073741824 Jul 21 17:31:17 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (c2cf96c4-5b62-483f-b50f-0043117e257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd1bf90-a140-4fd5-93ed-6be37af75582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd1bf90-a140-4fd5-93ed-6be37af75582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-483030659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ece29ad-780a-430a-a786-9b39bf61526d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:17Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfe8fd1-01c7-459b-a589-e4dc197b06e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfe8fd1-01c7-459b-a589-e4dc197b06e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab55c471-568a-4300-be09-b039d8a2f0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab55c471-568a-4300-be09-b039d8a2f0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ece29ad-780a-430a-a786-9b39bf61526d', 'volume_name': 'volume-9ece29ad-780a-430a-a786-9b39bf61526d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d217cb1-da32-42de-9ed7-105120b466d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d217cb1-da32-42de-9ed7-105120b466d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b7e9f5-da0e-4035-bece-7a11c4267d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Volume 9ece29ad-780a-430a-a786-9b39bf61526d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ece29ad-780a-430a-a786-9b39bf61526d', 'volume_size': 1} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:17 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 1073741824" returned: 0 in 0.500s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:17 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 Jul 21 17:31:17 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (84c39fd9-2640-437d-9c8d-d0752df60879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65df96b0-a5d6-4c75-9306-fc4feb05319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65df96b0-a5d6-4c75-9306-fc4feb05319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606807477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c818952d-6c88-47a9-8484-b31a0bcbb6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:18Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38e3c05-1eb6-4d07-a56b-47b91df72667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38e3c05-1eb6-4d07-a56b-47b91df72667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488516b2-e169-4bac-b387-f4d504693ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488516b2-e169-4bac-b387-f4d504693ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c818952d-6c88-47a9-8484-b31a0bcbb6c3', 'volume_name': 'volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5b5f35-cf74-4e7c-83e1-36ccea5ba72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5b5f35-cf74-4e7c-83e1-36ccea5ba72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286930a1-7d9a-482a-a921-28d05067621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Volume c818952d-6c88-47a9-8484-b31a0bcbb6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3', 'volume_size': 1} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:17 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0" returned: 0 in 0.265s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-483030659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ece29ad-780a-430a-a786-9b39bf61526d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:17Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Creating volume 9ece29ad-780a-430a-a786-9b39bf61526d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:17 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053f822c-b11a-4abd-a0b9-09d0db3940b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d 1073741824 Jul 21 17:31:17 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc98383-f0c6-4fc0-8a5b-a1e9bb9aec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Volume volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 (bb856455-3120-42dc-8f26-aad2b4b5dcf0): created successfully Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc98383-f0c6-4fc0-8a5b-a1e9bb9aec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (9b2dda20-5fd6-4bc8-bb7e-5fe979dfeaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d2084f7d-fcf4-4236-aff7-13706c9f3b4d tempest-CreateVolumesFromImageTest-78959168 None] Created volume successfully. Jul 21 17:31:17 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (82689b05-8009-4f79-8149-0c9eaa290a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b904623d-a5f0-419e-ab40-a0e37693e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b904623d-a5f0-419e-ab40-a0e37693e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2056788847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ad4648-b130-4945-b621-dd8643b27063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:18Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ec0c8e-30ba-4246-8610-75342c2dd823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ec0c8e-30ba-4246-8610-75342c2dd823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e81a083-a08c-4464-b90a-f68efce16655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e81a083-a08c-4464-b90a-f68efce16655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ad4648-b130-4945-b621-dd8643b27063', 'volume_name': 'volume-c7ad4648-b130-4945-b621-dd8643b27063', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11f7680-13db-4513-bc20-3b7ea7146d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11f7680-13db-4513-bc20-3b7ea7146d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31c9b86-cb96-4c71-805a-cbce0e91e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Volume c7ad4648-b130-4945-b621-dd8643b27063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ad4648-b130-4945-b621-dd8643b27063', 'volume_size': 1} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:18 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d 1073741824" returned: 0 in 0.475s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:18 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d Jul 21 17:31:18 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (262391a0-09f8-48b3-88a6-d74290155126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b14667d-b579-4a07-9343-56baefe8b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b14667d-b579-4a07-9343-56baefe8b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1522406534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c991d5c-51c7-4cbf-978b-571ec53b1705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:18Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa94297b-df2c-460f-a3ef-6076dfe4f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa94297b-df2c-460f-a3ef-6076dfe4f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e4c660-390f-4378-9345-d6888915e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e4c660-390f-4378-9345-d6888915e50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c991d5c-51c7-4cbf-978b-571ec53b1705', 'volume_name': 'volume-3c991d5c-51c7-4cbf-978b-571ec53b1705', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0406663e-f1be-4f9b-92d0-4ea2f7ff2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0406663e-f1be-4f9b-92d0-4ea2f7ff2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d063e550-b2b3-400f-a724-4b3ac444dc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Volume 3c991d5c-51c7-4cbf-978b-571ec53b1705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c991d5c-51c7-4cbf-978b-571ec53b1705', 'volume_size': 1} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:18 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d" returned: 0 in 0.251s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606807477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c818952d-6c88-47a9-8484-b31a0bcbb6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:18Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Creating volume c818952d-6c88-47a9-8484-b31a0bcbb6c3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:18 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b7e9f5-da0e-4035-bece-7a11c4267d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ece29ad-780a-430a-a786-9b39bf61526d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 1073741824 Jul 21 17:31:18 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2cf34e-dce6-4549-b2c7-1c74b178b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Volume volume-9ece29ad-780a-430a-a786-9b39bf61526d (9ece29ad-780a-430a-a786-9b39bf61526d): created successfully Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2cf34e-dce6-4549-b2c7-1c74b178b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (c2cf96c4-5b62-483f-b50f-0043117e257e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-123ce9a8-0c94-456d-9aca-aba61423b67b tempest-CreateVolumesFromImageTest-78959168 None] Created volume successfully. Jul 21 17:31:18 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 1073741824" returned: 0 in 0.388s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:19 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 Jul 21 17:31:19 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:19 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3" returned: 0 in 0.243s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2056788847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ad4648-b130-4945-b621-dd8643b27063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:18Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Creating volume c7ad4648-b130-4945-b621-dd8643b27063 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286930a1-7d9a-482a-a921-28d05067621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:19 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 1073741824 Jul 21 17:31:19 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150d7f7-7bcc-41b7-80e7-ff4fed996ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Volume volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 (c818952d-6c88-47a9-8484-b31a0bcbb6c3): created successfully Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150d7f7-7bcc-41b7-80e7-ff4fed996ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (84c39fd9-2640-437d-9c8d-d0752df60879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3b13bfa1-9f68-4ff1-bf94-5664001c2b11 tempest-CreateVolumesFromImageTest-78959168 None] Created volume successfully. Jul 21 17:31:19 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 1073741824" returned: 0 in 0.423s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:19 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 Jul 21 17:31:19 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:19 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063" returned: 0 in 0.238s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1522406534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c991d5c-51c7-4cbf-978b-571ec53b1705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1962ae5ae094e4ea2df35b7099feff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:18Z,use_quota=True,user_id='4303140ee5c64a98af448871ecf2b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Creating volume 3c991d5c-51c7-4cbf-978b-571ec53b1705 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31c9b86-cb96-4c71-805a-cbce0e91e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ad4648-b130-4945-b621-dd8643b27063', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266e477f-a004-4dc8-b4df-ef2e26883c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:20 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 1073741824 Jul 21 17:31:20 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Volume volume-c7ad4648-b130-4945-b621-dd8643b27063 (c7ad4648-b130-4945-b621-dd8643b27063): created successfully Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266e477f-a004-4dc8-b4df-ef2e26883c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (82689b05-8009-4f79-8149-0c9eaa290a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-22c9767c-dd74-43e6-ba57-273817790889 tempest-CreateVolumesFromImageTest-78959168 None] Created volume successfully. Jul 21 17:31:20 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 1073741824" returned: 0 in 0.415s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:20 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 Jul 21 17:31:20 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:20 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d063e550-b2b3-400f-a724-4b3ac444dc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c991d5c-51c7-4cbf-978b-571ec53b1705', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9dc4f7-7218-4183-8f26-31f3cd759bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Volume volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 (3c991d5c-51c7-4cbf-978b-571ec53b1705): created successfully Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9dc4f7-7218-4183-8f26-31f3cd759bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Flow 'volume_create_manager' (262391a0-09f8-48b3-88a6-d74290155126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-cce951f5-e341-4549-8550-88557ed797ba tempest-CreateVolumesFromImageTest-78959168 None] Created volume successfully. Jul 21 17:31:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-3c991d5c-51c7-4cbf-978b-571ec53b1705-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-3c991d5c-51c7-4cbf-978b-571ec53b1705-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-quobyte-3c991d5c-51c7-4cbf-978b-571ec53b1705" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-3c991d5c-51c7-4cbf-978b-571ec53b1705" acquired by "delete_volume" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b858a9a-48c4-4e9c-b64a-e764429de41c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:21 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 Jul 21 17:31:21 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:22 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705" returned: 0 in 0.351s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:22 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705 Jul 21 17:31:22 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:22 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-3c991d5c-51c7-4cbf-978b-571ec53b1705" returned: 0 in 0.244s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-3c991d5c-51c7-4cbf-978b-571ec53b1705" released by "delete_volume" :: held 0.634s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Created reservations ['ca8456c6-b383-4f69-8045-387294f7b7cb', '7a2fc226-625e-4913-bbc7-ef6ef572b9a9', '79f5d2e0-3182-4a67-96c9-c99fa938881e', 'a83bb2df-e51e-4d53-b155-20e12bff6e92'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:22 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:22 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:22 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Deleted volume successfully. Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7a9ec5e1-dd85-4b87-aea8-3ba0a4c4b82f tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-3c991d5c-51c7-4cbf-978b-571ec53b1705-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-c7ad4648-b130-4945-b621-dd8643b27063-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-c7ad4648-b130-4945-b621-dd8643b27063-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-quobyte-c7ad4648-b130-4945-b621-dd8643b27063" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-c7ad4648-b130-4945-b621-dd8643b27063" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c5fb1-9d3a-455e-a12c-c9dd6da38910]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:23 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 Jul 21 17:31:23 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:23 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063" returned: 0 in 0.340s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:23 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063 Jul 21 17:31:23 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:23 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c7ad4648-b130-4945-b621-dd8643b27063" returned: 0 in 0.254s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-c7ad4648-b130-4945-b621-dd8643b27063" released by "delete_volume" :: held 0.630s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Created reservations ['9a0c9745-abb8-42e7-892c-d77d407eab10', '9292b33e-ddd0-436c-a3f7-2ad4512cee6e', '2c3ee948-ae8e-4664-930f-bacbeac2805e', '9dc2c70b-9554-4282-a68c-7015773d503e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:23 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:23 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:23 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.234s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Deleted volume successfully. Jul 21 17:31:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3e1a2e3c-001a-458b-8fcb-ed3188763304 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-c7ad4648-b130-4945-b621-dd8643b27063-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-c818952d-6c88-47a9-8484-b31a0bcbb6c3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-c818952d-6c88-47a9-8484-b31a0bcbb6c3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-quobyte-c818952d-6c88-47a9-8484-b31a0bcbb6c3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-c818952d-6c88-47a9-8484-b31a0bcbb6c3" acquired by "delete_volume" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31298f8-160c-4867-97b8-eb933ac694f9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:24 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 Jul 21 17:31:24 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:24 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3" returned: 0 in 0.342s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:24 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3 Jul 21 17:31:24 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:24 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-c818952d-6c88-47a9-8484-b31a0bcbb6c3" returned: 0 in 0.234s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-c818952d-6c88-47a9-8484-b31a0bcbb6c3" released by "delete_volume" :: held 0.614s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Created reservations ['e1e769c2-dfd0-416b-8f04-3e93408b1e31', '62ced92a-700f-46e5-8061-080b63f48d2f', 'ad733f95-1bc6-4821-9de0-cfd0797a3093', '9c9d1315-f4bc-44fe-9bea-4120bc466423'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:24 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:24 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:25 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.236s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Deleted volume successfully. Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-b86c0ac2-6467-4294-b2ea-71d6b0abf4c6 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-c818952d-6c88-47a9-8484-b31a0bcbb6c3-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-9ece29ad-780a-430a-a786-9b39bf61526d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-9ece29ad-780a-430a-a786-9b39bf61526d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-quobyte-9ece29ad-780a-430a-a786-9b39bf61526d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-9ece29ad-780a-430a-a786-9b39bf61526d" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61afd32-c7d7-47d4-9ec3-87960320e07e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:25 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d Jul 21 17:31:25 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:25 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:25 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d Jul 21 17:31:25 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:25 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9ece29ad-780a-430a-a786-9b39bf61526d" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-9ece29ad-780a-430a-a786-9b39bf61526d" released by "delete_volume" :: held 0.630s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Created reservations ['9b0628b5-dc0e-49e5-8a22-6e6149dbfe92', 'f8cbfa92-2ae0-48f7-b490-9925a7b5d215', 'ecc5201b-af27-4cd3-8641-15f647046e5a', '22e6ee62-3800-4c25-bf05-910e0bd68fc3'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:26 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:26 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:26 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.236s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Deleted volume successfully. Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-eccf7473-3758-4954-814c-42c40c3ac112 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-9ece29ad-780a-430a-a786-9b39bf61526d-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-bb856455-3120-42dc-8f26-aad2b4b5dcf0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-bb856455-3120-42dc-8f26-aad2b4b5dcf0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "cinder-quobyte-bb856455-3120-42dc-8f26-aad2b4b5dcf0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-bb856455-3120-42dc-8f26-aad2b4b5dcf0" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a646267-c31a-49f2-969c-a23fb4c73d27]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:26 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 Jul 21 17:31:26 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:26 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0" returned: 0 in 0.352s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:26 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0 Jul 21 17:31:26 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:27 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-bb856455-3120-42dc-8f26-aad2b4b5dcf0" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-quobyte-bb856455-3120-42dc-8f26-aad2b4b5dcf0" released by "delete_volume" :: held 0.625s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Created reservations ['a21f039c-042a-4073-b819-7536799c96d0', '5a121324-fade-45cf-bfc5-9689339e2b9e', '7ea0fadc-b3fe-4a3f-acd0-3a0395fc6535', '92dbd27a-eea5-495d-a99c-cc882014a87b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:27 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:27 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:27 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Deleted volume successfully. Jul 21 17:31:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f2f99e9a-31c4-477b-8378-3518f87df790 tempest-CreateVolumesFromImageTest-78959168 None] Lock "cinder-bb856455-3120-42dc-8f26-aad2b4b5dcf0-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Flow 'volume_create_manager' (ff051fae-84a5-4a0d-ab74-13fdbd8b874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f668d0d8-9020-4adc-8ae2-a129319752c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f668d0d8-9020-4adc-8ae2-a129319752c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990413034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007f3670-2970-4bad-b1d5-153ea21d6006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2bfd7aab184346b09d11a5c0faa96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:30Z,use_quota=True,user_id='6ddacd8e591645b5846a6f316579c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d81d35-5311-4a84-8831-481a9ab64f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d81d35-5311-4a84-8831-481a9ab64f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a64eaf3-c466-45f3-97a3-1b8426559562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a64eaf3-c466-45f3-97a3-1b8426559562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007f3670-2970-4bad-b1d5-153ea21d6006', 'volume_name': 'volume-007f3670-2970-4bad-b1d5-153ea21d6006', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413a61c8-97c0-4c30-8182-36968978d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413a61c8-97c0-4c30-8182-36968978d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f2b221-9148-4790-bb45-68abd940cbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Volume 007f3670-2970-4bad-b1d5-153ea21d6006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007f3670-2970-4bad-b1d5-153ea21d6006', 'volume_size': 1} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990413034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007f3670-2970-4bad-b1d5-153ea21d6006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2bfd7aab184346b09d11a5c0faa96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:30Z,use_quota=True,user_id='6ddacd8e591645b5846a6f316579c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Creating volume 007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:30 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:30 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 1073741824 Jul 21 17:31:30 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:30 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 1073741824" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:30 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:30 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:30 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.234s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f2b221-9148-4790-bb45-68abd940cbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007f3670-2970-4bad-b1d5-153ea21d6006', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7637ec-cb6e-41f1-ac64-074c7019a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Volume volume-007f3670-2970-4bad-b1d5-153ea21d6006 (007f3670-2970-4bad-b1d5-153ea21d6006): created successfully Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7637ec-cb6e-41f1-ac64-074c7019a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Flow 'volume_create_manager' (ff051fae-84a5-4a0d-ab74-13fdbd8b874b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-aaa0ed50-aa09-40b8-a9aa-473e303020c5 tempest-VolumeDependencyTests-1000610780 None] Created volume successfully. Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Creating offline snapshot ee24953c-9f22-46a9-90b4-76caa8b2d79c of volume 007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c495e-705d-435c-85dc-aeed19cecfca]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:31 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:31 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:31 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:31 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c 1G Jul 21 17:31:31 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:31 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c 1G" returned: 0 in 0.385s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-007f3670-2970-4bad-b1d5-153ea21d6006 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:32 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-007f3670-2970-4bad-b1d5-153ea21d6006 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c Jul 21 17:31:32 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:32 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-007f3670-2970-4bad-b1d5-153ea21d6006 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c" returned: 0 in 0.283s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:32 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c is being set with open permissions: ugo+rw Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:32 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c Jul 21 17:31:32 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:32 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:32 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info Jul 21 17:31:32 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:32 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info" returned: 0 in 0.238s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:32 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info is being set with open permissions: ugo+rw Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:32 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info Jul 21 17:31:32 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:32 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.info" returned: 0 in 0.231s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:33 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b6cfe1d7-fc45-47df-af41-7d487aa24c72 tempest-VolumeDependencyTests-1000610780 None] Create snapshot completed successfully Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Flow 'volume_create_manager' (4165ac78-2bd7-463d-9c6a-bebd6f6356be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c024a1-7ffb-4a15-9ac6-4651f275cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c024a1-7ffb-4a15-9ac6-4651f275cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-758584592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddff529-938b-4c66-b728-6b4a063e3951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2bfd7aab184346b09d11a5c0faa96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee24953c-9f22-46a9-90b4-76caa8b2d79c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:34Z,use_quota=True,user_id='6ddacd8e591645b5846a6f316579c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d06e5fc-ef80-413f-836a-219799bc2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d06e5fc-ef80-413f-836a-219799bc2b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde2af11-0bf4-4ce6-a7e9-3d04ddb6ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde2af11-0bf4-4ce6-a7e9-3d04ddb6ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eddff529-938b-4c66-b728-6b4a063e3951', 'volume_name': 'volume-eddff529-938b-4c66-b728-6b4a063e3951', 'volume_size': 1, 'snapshot_id': 'ee24953c-9f22-46a9-90b4-76caa8b2d79c'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f631b27-6010-498f-9dd9-9f6dbae3a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f631b27-6010-498f-9dd9-9f6dbae3a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ae798c-8bb1-4f3c-9208-1baec977fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:33 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Volume eddff529-938b-4c66-b728-6b4a063e3951: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eddff529-938b-4c66-b728-6b4a063e3951', 'volume_size': 1, 'snapshot_id': 'ee24953c-9f22-46a9-90b4-76caa8b2d79c'} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-quobyte-ee24953c-9f22-46a9-90b4-76caa8b2d79c-eddff529-938b-4c66-b728-6b4a063e3951" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-ee24953c-9f22-46a9-90b4-76caa8b2d79c-eddff529-938b-4c66-b728-6b4a063e3951" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Creating volume eddff529-938b-4c66-b728-6b4a063e3951 from snapshot ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-quobyte-eddff529-938b-4c66-b728-6b4a063e3951" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-eddff529-938b-4c66-b728-6b4a063e3951" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] snapshot: ee24953c-9f22-46a9-90b4-76caa8b2d79c, volume: eddff529-938b-4c66-b728-6b4a063e3951, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9501d-d8df-4975-8c51-0c339d835d3c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:34 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c Jul 21 17:31:34 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:34 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c" returned: 0 in 0.339s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-007f3670-2970-4bad-b1d5-153ea21d6006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919aa8e-67c5-43e3-9280-4e3a0eb5edfb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:34 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:34 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:34 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.347s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:31:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:34 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 Jul 21 17:31:34 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:38 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951" returned: 0 in 3.890s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:38 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e803d122-2218-4072-af9e-734738e5dda8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:38 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:38 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:39 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006, size 1024.00 MB, duration 3.89 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:31:39 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Converted 1024.00 MB image at 263.17 MB/s Jul 21 17:31:39 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 is being set with open permissions: ugo+rw Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:39 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 Jul 21 17:31:39 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:39 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-eddff529-938b-4c66-b728-6b4a063e3951" released by "_copy_volume_from_snapshot" :: held 5.423s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-ee24953c-9f22-46a9-90b4-76caa8b2d79c-eddff529-938b-4c66-b728-6b4a063e3951" released by "_create_volume_from_snapshot" :: held 5.448s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.462s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ae798c-8bb1-4f3c-9208-1baec977fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddff529-938b-4c66-b728-6b4a063e3951', 'volume_size': 1, 'snapshot_id': 'ee24953c-9f22-46a9-90b4-76caa8b2d79c'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3874ed-9bea-4bc5-9115-ad3cd6b8a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:39 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Volume volume-eddff529-938b-4c66-b728-6b4a063e3951 (eddff529-938b-4c66-b728-6b4a063e3951): created successfully Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3874ed-9bea-4bc5-9115-ad3cd6b8a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Flow 'volume_create_manager' (4165ac78-2bd7-463d-9c6a-bebd6f6356be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-67783687-5340-4f9c-bed8-5c3ff9a4f82c tempest-VolumeDependencyTests-1000610780 None] Created volume successfully. Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-ee24953c-9f22-46a9-90b4-76caa8b2d79c-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-ee24953c-9f22-46a9-90b4-76caa8b2d79c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-quobyte-007f3670-2970-4bad-b1d5-153ea21d6006" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-007f3670-2970-4bad-b1d5-153ea21d6006" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-quobyte-ee24953c-9f22-46a9-90b4-76caa8b2d79c" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-ee24953c-9f22-46a9-90b4-76caa8b2d79c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Deleting offline snapshot ee24953c-9f22-46a9-90b4-76caa8b2d79c of volume 007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] snapshot_file for this snap is: volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a82f3-9ec5-49b4-84d7-bc1f418cdf8a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:40 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c Jul 21 17:31:40 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:40 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c" returned: 0 in 0.344s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-007f3670-2970-4bad-b1d5-153ea21d6006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[81484e1a-e98b-4644-90d9-4b12c687cb99]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:40 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:40 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:41 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.345s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:41 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c Jul 21 17:31:41 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:41 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c" returned: 0 in 0.326s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:41 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c Jul 21 17:31:41 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:41 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006.ee24953c-9f22-46a9-90b4-76caa8b2d79c" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-ee24953c-9f22-46a9-90b4-76caa8b2d79c" released by "_delete_snapshot" :: held 1.373s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-007f3670-2970-4bad-b1d5-153ea21d6006" released by "delete_snapshot" :: held 1.394s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Created reservations ['1500f715-e39b-4f86-9b52-b9c326c646be', '957f6a06-5d70-4c23-8d2c-da9a0a8540af', 'cbcd4d97-50f2-4626-a78e-b60247563973', 'd7488236-daa0-4c09-9754-8d888646d8a2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Delete snapshot completed successfully. Jul 21 17:31:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-964a7ead-17e9-4423-a328-0c3e32c6963d tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-ee24953c-9f22-46a9-90b4-76caa8b2d79c-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:42 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:42 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:42 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.235s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-007f3670-2970-4bad-b1d5-153ea21d6006-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-007f3670-2970-4bad-b1d5-153ea21d6006-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-quobyte-007f3670-2970-4bad-b1d5-153ea21d6006" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-007f3670-2970-4bad-b1d5-153ea21d6006" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d22b367-ecbd-40bf-8bfa-1b16667cbcc6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:42 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:42 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:42 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.354s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:42 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006 Jul 21 17:31:42 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:43 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-007f3670-2970-4bad-b1d5-153ea21d6006" returned: 0 in 0.233s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-007f3670-2970-4bad-b1d5-153ea21d6006" released by "delete_volume" :: held 0.642s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Created reservations ['e7951424-1baa-436d-9766-524163a2237e', '76a7c8ea-51f8-4062-b6f2-ba1f8c2e3733', 'aec60b82-9075-47cf-b17b-728661e3c7b8', '0e6232d5-996f-4487-a6cc-821ed2554ef0'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:43 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:43 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:43 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.236s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Deleted volume successfully. Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d84188f8-06cd-4ac9-8c05-8480be06c439 tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-007f3670-2970-4bad-b1d5-153ea21d6006-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-eddff529-938b-4c66-b728-6b4a063e3951-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-eddff529-938b-4c66-b728-6b4a063e3951-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "cinder-quobyte-eddff529-938b-4c66-b728-6b4a063e3951" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-eddff529-938b-4c66-b728-6b4a063e3951" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1c10f-7975-4513-a2b4-3626b62dc663]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:43 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 Jul 21 17:31:43 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:43 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:44 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951 Jul 21 17:31:44 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:44 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-eddff529-938b-4c66-b728-6b4a063e3951" returned: 0 in 0.236s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-quobyte-eddff529-938b-4c66-b728-6b4a063e3951" released by "delete_volume" :: held 0.614s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Created reservations ['6e312a5b-0213-4c6c-b62d-933faf90de3b', '900e749f-1ffd-4cf3-8b82-7910f9dce023', 'dc7d9896-049d-45c7-9331-b1d7a8fb0e15', '1b800c19-7e0a-4a5a-8a8f-5ce306060485'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:44 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:44 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:44 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Deleted volume successfully. Jul 21 17:31:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c51253f1-ddbf-486c-b674-4cb01a2f642a tempest-VolumeDependencyTests-1000610780 None] Lock "cinder-eddff529-938b-4c66-b728-6b4a063e3951-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (568a6aea-febe-4fc0-a8e0-8cb31e39c1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d43d15b-d148-4419-9f58-80156d69a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=78,cinder:UPDATE=103,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d43d15b-d148-4419-9f58-80156d69a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681874210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101d9a16-71a8-441e-bd36-fd4fdc579c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:52Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7f0e0c-fd86-4829-b2f3-3042e3cda96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7f0e0c-fd86-4829-b2f3-3042e3cda96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69bc9a-3b78-42b9-9466-aeedce29bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69bc9a-3b78-42b9-9466-aeedce29bb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101d9a16-71a8-441e-bd36-fd4fdc579c11', 'volume_name': 'volume-101d9a16-71a8-441e-bd36-fd4fdc579c11', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3400eea3-75bf-442a-bf78-330ace5d2cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3400eea3-75bf-442a-bf78-330ace5d2cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf099d0-9462-4811-a2b5-3fd3228dda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:51 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Volume 101d9a16-71a8-441e-bd36-fd4fdc579c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101d9a16-71a8-441e-bd36-fd4fdc579c11', 'volume_size': 1} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681874210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101d9a16-71a8-441e-bd36-fd4fdc579c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:52Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Creating volume 101d9a16-71a8-441e-bd36-fd4fdc579c11 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:51 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:51 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 1073741824 Jul 21 17:31:51 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:52 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 1073741824" returned: 0 in 0.422s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:52 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 Jul 21 17:31:52 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:52 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf099d0-9462-4811-a2b5-3fd3228dda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101d9a16-71a8-441e-bd36-fd4fdc579c11', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a629a9e9-d6f8-45e1-86f8-a4dba881fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:52 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Volume volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 (101d9a16-71a8-441e-bd36-fd4fdc579c11): created successfully Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a629a9e9-d6f8-45e1-86f8-a4dba881fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (568a6aea-febe-4fc0-a8e0-8cb31e39c1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7e647da3-5c3c-4074-9813-d9f4eef6f753 tempest-ProjectReaderTests-902443726 None] Created volume successfully. Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-101d9a16-71a8-441e-bd36-fd4fdc579c11-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Lock "cinder-101d9a16-71a8-441e-bd36-fd4fdc579c11-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-quobyte-101d9a16-71a8-441e-bd36-fd4fdc579c11" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-101d9a16-71a8-441e-bd36-fd4fdc579c11" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f00fb4-7a8f-40da-afec-9cf06fcef39a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:53 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 Jul 21 17:31:53 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:53 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11" returned: 0 in 0.345s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:53 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11 Jul 21 17:31:53 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:53 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-101d9a16-71a8-441e-bd36-fd4fdc579c11" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-101d9a16-71a8-441e-bd36-fd4fdc579c11" released by "delete_volume" :: held 0.619s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Created reservations ['a36859aa-551c-4da5-9623-d722374decd3', '828c55ba-4abc-48c8-92f8-688b9baa3375', 'c9d66bb3-0493-44c0-bcf9-51c6302f19c8', '0b104f0e-83d0-47f5-a07f-da4b6dc36323'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:53 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:53 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:53 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.246s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Deleted volume successfully. Jul 21 17:31:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-efa38ada-988b-44eb-ae00-7a4043938aa4 tempest-ProjectReaderTests-902443726 None] Lock "cinder-101d9a16-71a8-441e-bd36-fd4fdc579c11-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (cef85653-db32-414d-9583-34399778c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b93303-9d15-4601-9783-b16fa5791d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b93303-9d15-4601-9783-b16fa5791d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173969072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a3740e-8afd-472d-9c1d-8ef60e129bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:54Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366e7203-e8b8-42e4-9d40-7968abbcc545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366e7203-e8b8-42e4-9d40-7968abbcc545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c928440-9022-49eb-880f-1f2914f47694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c928440-9022-49eb-880f-1f2914f47694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a3740e-8afd-472d-9c1d-8ef60e129bf7', 'volume_name': 'volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828debfa-1bd6-4f50-a691-a0b0c0bece79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828debfa-1bd6-4f50-a691-a0b0c0bece79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed21dd6-a34e-4b65-b1ce-553f9dfd97c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Volume a2a3740e-8afd-472d-9c1d-8ef60e129bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7', 'volume_size': 1} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173969072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a3740e-8afd-472d-9c1d-8ef60e129bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:54Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Creating volume a2a3740e-8afd-472d-9c1d-8ef60e129bf7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:54 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:54 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 1073741824 Jul 21 17:31:54 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:54 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 1073741824" returned: 0 in 0.406s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:55 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 Jul 21 17:31:55 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:55 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7" returned: 0 in 0.244s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed21dd6-a34e-4b65-b1ce-553f9dfd97c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c473db-c4d9-426d-bef0-ae43a88dafbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:55 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Volume volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 (a2a3740e-8afd-472d-9c1d-8ef60e129bf7): created successfully Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c473db-c4d9-426d-bef0-ae43a88dafbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (cef85653-db32-414d-9583-34399778c50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-71b62a73-d8cb-4be2-8038-fea33cd3bd76 tempest-ProjectReaderTests-902443726 None] Created volume successfully. Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-a2a3740e-8afd-472d-9c1d-8ef60e129bf7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Lock "cinder-a2a3740e-8afd-472d-9c1d-8ef60e129bf7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-quobyte-a2a3740e-8afd-472d-9c1d-8ef60e129bf7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-a2a3740e-8afd-472d-9c1d-8ef60e129bf7" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee601ca-a191-4d52-8979-e31a4a4bc5df]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:55 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 Jul 21 17:31:55 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:55 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:55 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7 Jul 21 17:31:55 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:56 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-a2a3740e-8afd-472d-9c1d-8ef60e129bf7" returned: 0 in 0.234s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-a2a3740e-8afd-472d-9c1d-8ef60e129bf7" released by "delete_volume" :: held 0.611s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Created reservations ['b837e587-6ef3-431c-b91d-998bc184cc6c', '62086776-44e3-4926-a289-00838fa69058', '87dd3134-b1bb-470b-9e7c-e8309405b293', '1be666c9-90a4-4ca3-a04e-9e4a50d57f68'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:56 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:56 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:56 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Deleted volume successfully. Jul 21 17:31:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f0104762-69d7-4f73-9413-65b7511e4d8e tempest-ProjectReaderTests-902443726 None] Lock "cinder-a2a3740e-8afd-472d-9c1d-8ef60e129bf7-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (3b53b90e-68b3-46c2-8354-abcb41999084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b65e9ca-e81b-4c5e-85a9-650b02842b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b65e9ca-e81b-4c5e-85a9-650b02842b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172860205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeda27e-9752-4a70-b48d-4ed6409775f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:57Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71801ea-87e4-4bfb-b0c4-c65fe41cc578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71801ea-87e4-4bfb-b0c4-c65fe41cc578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6f6c85-9d07-42e8-a27f-e12ceff61122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6f6c85-9d07-42e8-a27f-e12ceff61122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdeda27e-9752-4a70-b48d-4ed6409775f3', 'volume_name': 'volume-cdeda27e-9752-4a70-b48d-4ed6409775f3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec8cda2-25e3-4979-9df2-6d82f248420d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec8cda2-25e3-4979-9df2-6d82f248420d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c13a91e-12fa-4172-a2eb-fe434f93fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Volume cdeda27e-9752-4a70-b48d-4ed6409775f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdeda27e-9752-4a70-b48d-4ed6409775f3', 'volume_size': 1} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172860205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeda27e-9752-4a70-b48d-4ed6409775f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:31:57Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Creating volume cdeda27e-9752-4a70-b48d-4ed6409775f3 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:57 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:57 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 1073741824 Jul 21 17:31:57 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:57 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 1073741824" returned: 0 in 0.405s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:57 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 Jul 21 17:31:57 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:57 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c13a91e-12fa-4172-a2eb-fe434f93fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdeda27e-9752-4a70-b48d-4ed6409775f3', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1104463-739f-4c12-ad3c-88e285571d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:57 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Volume volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 (cdeda27e-9752-4a70-b48d-4ed6409775f3): created successfully Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1104463-739f-4c12-ad3c-88e285571d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:57 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (3b53b90e-68b3-46c2-8354-abcb41999084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7a3103bf-27ec-4c06-9834-8a1499208ac5 tempest-ProjectReaderTests-902443726 None] Created volume successfully. Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-cdeda27e-9752-4a70-b48d-4ed6409775f3-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Lock "cinder-cdeda27e-9752-4a70-b48d-4ed6409775f3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-quobyte-cdeda27e-9752-4a70-b48d-4ed6409775f3" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-cdeda27e-9752-4a70-b48d-4ed6409775f3" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a562463-d960-4a42-a297-d4d418c48d63]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:58 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 Jul 21 17:31:58 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:58 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3" returned: 0 in 0.348s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:58 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3 Jul 21 17:31:58 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:58 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-cdeda27e-9752-4a70-b48d-4ed6409775f3" returned: 0 in 0.236s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-cdeda27e-9752-4a70-b48d-4ed6409775f3" released by "delete_volume" :: held 0.619s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:58 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Created reservations ['769e780d-18d9-4efb-adbd-70d52a699c84', '9e7618bc-a9eb-46cd-ada2-43358e9ff33c', '0d39fcc1-3f30-4f8c-b2eb-a250f9d63371', '4105ebb7-4ce8-4aa0-a8c4-8492df0cfa28'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:59 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:31:59 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:31:59 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:31:59 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Deleted volume successfully. Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-63958411-f853-4231-84e5-b9fd17ccdb1c tempest-ProjectReaderTests-902443726 None] Lock "cinder-cdeda27e-9752-4a70-b48d-4ed6409775f3-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (e0741660-6c0a-4148-ae71-6fe99c0109df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74546fff-0fc1-43d7-b2c5-51bb20e593cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74546fff-0fc1-43d7-b2c5-51bb20e593cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817590199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcb29ff-3d04-4f4e-af5d-fbd778231751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:00Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7de4a65-2a9e-450e-97e7-e001fa2b7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7de4a65-2a9e-450e-97e7-e001fa2b7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c06e3d6-0dea-48bf-a281-56071abe97d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c06e3d6-0dea-48bf-a281-56071abe97d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcb29ff-3d04-4f4e-af5d-fbd778231751', 'volume_name': 'volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991fdd9b-fdc2-418c-8764-5c6cdc085e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991fdd9b-fdc2-418c-8764-5c6cdc085e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e355fa-f018-4568-829d-c1bbd76fdf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:31:59 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Volume 9dcb29ff-3d04-4f4e-af5d-fbd778231751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751', 'volume_size': 1} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817590199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcb29ff-3d04-4f4e-af5d-fbd778231751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c794786abf7948f590a3daeda3a912b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:00Z,use_quota=True,user_id='52b44f3011624b00850b0806becf9662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Creating volume 9dcb29ff-3d04-4f4e-af5d-fbd778231751 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:31:59 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:31:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:31:59 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 1073741824 Jul 21 17:31:59 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:00 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 1073741824" returned: 0 in 0.399s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:00 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 Jul 21 17:32:00 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:00 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751" returned: 0 in 0.243s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e355fa-f018-4568-829d-c1bbd76fdf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251c7712-7568-49bd-a7bc-9b0864e6e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:00 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Volume volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 (9dcb29ff-3d04-4f4e-af5d-fbd778231751): created successfully Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251c7712-7568-49bd-a7bc-9b0864e6e960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Flow 'volume_create_manager' (e0741660-6c0a-4148-ae71-6fe99c0109df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-182f99ea-fee6-4b91-b38c-88be6912e3a3 tempest-ProjectReaderTests-902443726 None] Created volume successfully. Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-9dcb29ff-3d04-4f4e-af5d-fbd778231751-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Lock "cinder-9dcb29ff-3d04-4f4e-af5d-fbd778231751-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Acquiring lock "cinder-quobyte-9dcb29ff-3d04-4f4e-af5d-fbd778231751" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-9dcb29ff-3d04-4f4e-af5d-fbd778231751" acquired by "delete_volume" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[23893768-8f23-4a0b-a9e6-40738a03394b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:01 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 Jul 21 17:32:01 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:01 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751" returned: 0 in 0.349s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:01 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751 Jul 21 17:32:01 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:01 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9dcb29ff-3d04-4f4e-af5d-fbd778231751" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Lock "cinder-quobyte-9dcb29ff-3d04-4f4e-af5d-fbd778231751" released by "delete_volume" :: held 0.638s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Created reservations ['4db14935-6b95-4dd7-bcab-def6ed824b70', 'c7b7ba4d-6d23-47fe-872a-26e79a012362', '85f5470c-4c23-4b44-add0-38be9e7f0232', 'f9868f4f-3a10-4e68-b689-436e43188ab7'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:01 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:01 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:01 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Deleted volume successfully. Jul 21 17:32:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-16a42f42-ef67-4416-aee9-06d70113f222 tempest-ProjectReaderTests-902443726 None] Lock "cinder-9dcb29ff-3d04-4f4e-af5d-fbd778231751-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:11 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=135,cinder:SELECT=87,cinder:DELETE=9,cinder:INSERT=28 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:32:11 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=32,cinder:INSERT=12,cinder:UPDATE=42,cinder:DELETE=6 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:32:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (f36f1104-93a7-49fd-8c01-e5c9722585d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587ab9ab-684c-4c8b-80d3-3957eef43b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587ab9ab-684c-4c8b-80d3-3957eef43b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851000623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037310c9-88e7-4df7-9b7d-20f4ca0478bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:14Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647a5b83-eae3-4add-b70f-7937fad96fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647a5b83-eae3-4add-b70f-7937fad96fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeea18ab-eedf-4128-bd68-60a85b81a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeea18ab-eedf-4128-bd68-60a85b81a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037310c9-88e7-4df7-9b7d-20f4ca0478bf', 'volume_name': 'volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c14cc3-7f40-4d06-ade3-7dae287a5eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c14cc3-7f40-4d06-ade3-7dae287a5eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01c6a4-5a55-452b-b529-7b4baec40484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Volume 037310c9-88e7-4df7-9b7d-20f4ca0478bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf', 'volume_size': 1} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851000623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037310c9-88e7-4df7-9b7d-20f4ca0478bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:14Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Creating volume 037310c9-88e7-4df7-9b7d-20f4ca0478bf {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:14 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:14 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf 1073741824 Jul 21 17:32:14 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (2b224cd8-5880-47f5-bd61-2770d19df8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387bdc50-47eb-4954-882b-dc29e0cb5436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387bdc50-47eb-4954-882b-dc29e0cb5436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-516166730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78515d7a-b7a2-460e-97de-fe2971b230c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:14Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1283a606-bc6e-41dc-9ff0-1ad75e0392a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1283a606-bc6e-41dc-9ff0-1ad75e0392a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1fb36a-a043-409d-bb84-b6709f286b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1fb36a-a043-409d-bb84-b6709f286b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78515d7a-b7a2-460e-97de-fe2971b230c1', 'volume_name': 'volume-78515d7a-b7a2-460e-97de-fe2971b230c1', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07d45c3-ab7b-4205-9d58-0995c6dab1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07d45c3-ab7b-4205-9d58-0995c6dab1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacff257-b9a2-4247-a18b-9de254fef1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume 78515d7a-b7a2-460e-97de-fe2971b230c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78515d7a-b7a2-460e-97de-fe2971b230c1', 'volume_size': 1} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (22e3e925-e6fe-4db8-a9df-df2e5c39560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10d76a9-7873-41e8-a5a3-e45696bffdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10d76a9-7873-41e8-a5a3-e45696bffdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2091556376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c856a21-618c-4c78-b310-3eb958349359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:14Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d90474-bda1-4e80-98e0-e0f525570eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d90474-bda1-4e80-98e0-e0f525570eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b0a98-e24f-43c0-8772-be61425d8cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b0a98-e24f-43c0-8772-be61425d8cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c856a21-618c-4c78-b310-3eb958349359', 'volume_name': 'volume-8c856a21-618c-4c78-b310-3eb958349359', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3c3107-919a-4513-9a85-a63c3deab27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3c3107-919a-4513-9a85-a63c3deab27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7f28c2-7832-4823-96f7-32295fb702bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Volume 8c856a21-618c-4c78-b310-3eb958349359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c856a21-618c-4c78-b310-3eb958349359', 'volume_size': 1} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Flow 'volume_create_manager' (bd2deb3e-659d-4e9d-be72-1f0f76577470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3daa81-430c-446b-bd2e-837698e73dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3daa81-430c-446b-bd2e-837698e73dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1471788365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653d5f03-b78f-4722-a32e-87b1a0c63ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23465bd7c8ab409faf1072c9a9c8dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:15Z,use_quota=True,user_id='9cb3954178ca408f92b136d2f490e861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f50e0b-eb3d-45ec-aa4c-06cbc5830a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f50e0b-eb3d-45ec-aa4c-06cbc5830a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa4688d-92ad-4de3-a8e1-cac4fcfdb4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa4688d-92ad-4de3-a8e1-cac4fcfdb4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653d5f03-b78f-4722-a32e-87b1a0c63ee0', 'volume_name': 'volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e76e069-0bf8-4585-ad2f-6b9b34867a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e76e069-0bf8-4585-ad2f-6b9b34867a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6548fc23-d1dd-4f4d-9b03-3f749c246fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Volume 653d5f03-b78f-4722-a32e-87b1a0c63ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0', 'volume_size': 1} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf 1073741824" returned: 0 in 0.698s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:14 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf Jul 21 17:32:14 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (b2649ca5-9bf9-4d4c-bc30-2f8d9aa70037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102a13d9-40ce-447f-8146-5acb000d1fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102a13d9-40ce-447f-8146-5acb000d1fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803925731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6481e5c-61be-48d9-b14c-4c8b5fb7015b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:15Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b5bbf0-629b-47a6-b282-f99c24790131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b5bbf0-629b-47a6-b282-f99c24790131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b17bf6-dbe7-4b7e-b5af-1ff75eae8fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b17bf6-dbe7-4b7e-b5af-1ff75eae8fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6481e5c-61be-48d9-b14c-4c8b5fb7015b', 'volume_name': 'volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80598a33-9373-4604-ab4d-67f1d6848ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80598a33-9373-4604-ab4d-67f1d6848ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc754133-f85c-40be-a475-16ce756bd057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Volume d6481e5c-61be-48d9-b14c-4c8b5fb7015b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b', 'volume_size': 1} Jul 21 17:32:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:15 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf" returned: 0 in 0.272s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-516166730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78515d7a-b7a2-460e-97de-fe2971b230c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:14Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating volume 78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:15 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:15 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 1073741824 Jul 21 17:32:15 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01c6a4-5a55-452b-b529-7b4baec40484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8941670-f1d8-4172-8fca-235609dddb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Volume volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf (037310c9-88e7-4df7-9b7d-20f4ca0478bf): created successfully Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8941670-f1d8-4172-8fca-235609dddb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (f36f1104-93a7-49fd-8c01-e5c9722585d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-dfb75966-9554-42ab-b08f-e9e7dfe65a3b tempest-CreateVolumesFromImageTest-1978366784 None] Created volume successfully. Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (d82b158a-1645-4db2-ab0d-ee8284f81f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72d3405-d23b-4ffb-9266-dcc0e05d69a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72d3405-d23b-4ffb-9266-dcc0e05d69a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647298710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b6e885-6800-4576-873d-ea52f28e16cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:15Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed748a75-bf42-44d3-b714-c3eea0e7f0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed748a75-bf42-44d3-b714-c3eea0e7f0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a56ecd-be4b-4b49-a12d-d567723e9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a56ecd-be4b-4b49-a12d-d567723e9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b6e885-6800-4576-873d-ea52f28e16cb', 'volume_name': 'volume-40b6e885-6800-4576-873d-ea52f28e16cb', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cdc66f-180d-492b-94b3-281c7a6187d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cdc66f-180d-492b-94b3-281c7a6187d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfd88e5-9e73-450b-96ef-905a3b4a7c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Volume 40b6e885-6800-4576-873d-ea52f28e16cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b6e885-6800-4576-873d-ea52f28e16cb', 'volume_size': 1} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:15 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 1073741824" returned: 0 in 0.631s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (68677db1-b70b-42d9-b7d2-557b7d9e199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6a2f52-e4ec-4b6c-aeb3-3cc986da2b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6a2f52-e4ec-4b6c-aeb3-3cc986da2b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892499339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1283462b-32f9-41c2-842f-014bff2534e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:16Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f51d42-6380-40d4-8652-be4a497e17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f51d42-6380-40d4-8652-be4a497e17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1783f8be-b7c9-403a-b454-8627da643e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1783f8be-b7c9-403a-b454-8627da643e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1283462b-32f9-41c2-842f-014bff2534e2', 'volume_name': 'volume-1283462b-32f9-41c2-842f-014bff2534e2', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16b6308-5f3a-4f69-adbf-9eb9273b7aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16b6308-5f3a-4f69-adbf-9eb9273b7aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07428d9-5aa2-42c3-ac2d-1785b6589462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:15 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Volume 1283462b-32f9-41c2-842f-014bff2534e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1283462b-32f9-41c2-842f-014bff2534e2', 'volume_size': 1} Jul 21 17:32:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:16 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1" returned: 0 in 0.257s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2091556376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c856a21-618c-4c78-b310-3eb958349359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:14Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Creating volume 8c856a21-618c-4c78-b310-3eb958349359 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:16 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 1073741824 Jul 21 17:32:16 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacff257-b9a2-4247-a18b-9de254fef1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78515d7a-b7a2-460e-97de-fe2971b230c1', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3facbc7d-8f30-4102-b9f2-fa10f020e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume volume-78515d7a-b7a2-460e-97de-fe2971b230c1 (78515d7a-b7a2-460e-97de-fe2971b230c1): created successfully Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3facbc7d-8f30-4102-b9f2-fa10f020e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (2b224cd8-5880-47f5-bd61-2770d19df8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fee933cf-3f21-436b-b828-0c35774e21b1 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created volume successfully. Jul 21 17:32:16 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 1073741824" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:16 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 Jul 21 17:32:16 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:16 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359" returned: 0 in 0.278s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1471788365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653d5f03-b78f-4722-a32e-87b1a0c63ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23465bd7c8ab409faf1072c9a9c8dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:15Z,use_quota=True,user_id='9cb3954178ca408f92b136d2f490e861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Creating volume 653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7f28c2-7832-4823-96f7-32295fb702bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c856a21-618c-4c78-b310-3eb958349359', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7962bd03-363e-4c19-ba20-559ddeb833ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:16 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 1073741824 Jul 21 17:32:16 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Volume volume-8c856a21-618c-4c78-b310-3eb958349359 (8c856a21-618c-4c78-b310-3eb958349359): created successfully Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7962bd03-363e-4c19-ba20-559ddeb833ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (22e3e925-e6fe-4db8-a9df-df2e5c39560a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6a0da5b4-0c7e-4b53-b25a-f34cb5f99d80 tempest-CreateVolumesFromImageTest-1978366784 None] Created volume successfully. Jul 21 17:32:17 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 1073741824" returned: 0 in 0.456s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:17 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:17 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:17 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.693s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803925731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6481e5c-61be-48d9-b14c-4c8b5fb7015b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:15Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Creating volume d6481e5c-61be-48d9-b14c-4c8b5fb7015b {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:17 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:17 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b 1073741824 Jul 21 17:32:17 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6548fc23-d1dd-4f4d-9b03-3f749c246fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98522294-a5f8-4861-ae54-f9cbfc99dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Volume volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 (653d5f03-b78f-4722-a32e-87b1a0c63ee0): created successfully Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98522294-a5f8-4861-ae54-f9cbfc99dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Flow 'volume_create_manager' (bd2deb3e-659d-4e9d-be72-1f0f76577470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-965dd3cf-43c8-4430-8b2d-8724046d05e6 tempest-VolumeDependencyTests-1649611275 None] Created volume successfully. Jul 21 17:32:18 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Flow 'volume_create_manager' (04f28a95-1ed3-456f-a3a9-c900de318cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c900c84-6297-4bb3-8478-504e7bb12aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b 1073741824" returned: 0 in 0.493s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c900c84-6297-4bb3-8478-504e7bb12aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97247eb-55d1-4251-9855-5fd0a4755349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4798a545a6a54578a1928f6d4ec5442a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:18Z,use_quota=True,user_id='06c6142fbe2b41a79bbabe59814c3c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b956c113-ce01-4c1d-a5c3-196bb9ccb4b3),volume_type_id=b956c113-ce01-4c1d-a5c3-196bb9ccb4b3)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c11f156-43da-4c7b-88fd-4234302a91e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c11f156-43da-4c7b-88fd-4234302a91e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a65c4f-5c87-422f-8f8d-c3cecadd5bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:18 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b Jul 21 17:32:18 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:18 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.026s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647298710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b6e885-6800-4576-873d-ea52f28e16cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:15Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Creating volume 40b6e885-6800-4576-873d-ea52f28e16cb {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:18 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:18 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb 1073741824 Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a65c4f-5c87-422f-8f8d-c3cecadd5bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f97247eb-55d1-4251-9855-5fd0a4755349', 'volume_name': 'volume-f97247eb-55d1-4251-9855-5fd0a4755349', 'volume_size': 1, 'image_id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd86906ce946a4fe4813dc05652366a16', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4798a545a6a54578a1928f6d4ec5442a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f43fda7ca56aad659c5a2f28b3209d56c13bc69f8b88acf5a518c4d847d057feb3ca8ad372a4bb57c996c5af90bf2ed25e86262a2b932535c1e8145fd4fcec8d', 'id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'created_at': datetime.datetime(2026, 7, 21, 15, 32, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 32, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:18 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f823f776-2eb5-49f4-b93b-2d69917c1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f823f776-2eb5-49f4-b93b-2d69917c1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa4829-7190-4a4c-9cdd-ba4fdfb3a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Volume f97247eb-55d1-4251-9855-5fd0a4755349: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f97247eb-55d1-4251-9855-5fd0a4755349', 'volume_size': 1, 'image_id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd86906ce946a4fe4813dc05652366a16', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4798a545a6a54578a1928f6d4ec5442a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f43fda7ca56aad659c5a2f28b3209d56c13bc69f8b88acf5a518c4d847d057feb3ca8ad372a4bb57c996c5af90bf2ed25e86262a2b932535c1e8145fd4fcec8d', 'id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'created_at': datetime.datetime(2026, 7, 21, 15, 32, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 32, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Trying to clone f97247eb-55d1-4251-9855-5fd0a4755349 from image 75362bcd-7cc8-4d69-b7c2-65e810a733ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc754133-f85c-40be-a475-16ce756bd057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a789306-0285-4629-84e8-2670326a380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Volume volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b (d6481e5c-61be-48d9-b14c-4c8b5fb7015b): created successfully Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a789306-0285-4629-84e8-2670326a380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (b2649ca5-9bf9-4d4c-bc30-2f8d9aa70037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4dfa1358-fb21-4b45-8061-6f33e5e1c037 tempest-CreateVolumesFromImageTest-1978366784 None] Created volume successfully. Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:32:18 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Image download 0.00 MB at 0.00 MB/s Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[145063ad-3763-4ecb-ac5b-55fca58e96df]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:18 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD Jul 21 17:32:18 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:19 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb 1073741824" returned: 0 in 0.501s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:19 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb Jul 21 17:32:19 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:19 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:19 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD Jul 21 17:32:19 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:19 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb" returned: 0 in 0.245s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.450s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892499339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1283462b-32f9-41c2-842f-014bff2534e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5500122791584feb9bd810c0b344603e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:16Z,use_quota=True,user_id='337779c73e084ad8959baa79629d0f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Creating volume 1283462b-32f9-41c2-842f-014bff2534e2 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:19 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfd88e5-9e73-450b-96ef-905a3b4a7c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b6e885-6800-4576-873d-ea52f28e16cb', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:19 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 1073741824 Jul 21 17:32:19 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0765f2d7-bacb-4d35-bc7f-5f1d2aadb0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:19 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Volume volume-40b6e885-6800-4576-873d-ea52f28e16cb (40b6e885-6800-4576-873d-ea52f28e16cb): created successfully Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0765f2d7-bacb-4d35-bc7f-5f1d2aadb0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (d82b158a-1645-4db2-ab0d-ee8284f81f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:19 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e7574080-2293-49b1-a8e0-e5788dede585 tempest-CreateVolumesFromImageTest-1978366784 None] Created volume successfully. Jul 21 17:32:19 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Temporary image 75362bcd-7cc8-4d69-b7c2-65e810a733ba is fetched for user 06c6142fbe2b41a79bbabe59814c3c98. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eaa192-4fef-45c6-a047-e1c5182bf223]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:19 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD Jul 21 17:32:19 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:19 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 1073741824" returned: 0 in 0.443s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:19 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 Jul 21 17:32:19 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:19 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:20 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD Jul 21 17:32:20 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:20 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2" returned: 0 in 0.249s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.577s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07428d9-5aa2-42c3-ac2d-1785b6589462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1283462b-32f9-41c2-842f-014bff2534e2', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82326861-b37f-4ab8-9a2b-12ac600cb14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating offline snapshot 8709dc02-eebb-4114-996e-60da1255ba9b of volume 78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:32:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Volume volume-1283462b-32f9-41c2-842f-014bff2534e2 (1283462b-32f9-41c2-842f-014bff2534e2): created successfully Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82326861-b37f-4ab8-9a2b-12ac600cb14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Flow 'volume_create_manager' (68677db1-b70b-42d9-b7d2-557b7d9e199d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5e5db-6a5b-4ed4-9faa-feaa16322773]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-120212f1-f466-47ed-bd09-6821209d26d8 tempest-CreateVolumesFromImageTest-1978366784 None] Created volume successfully. Jul 21 17:32:20 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 Jul 21 17:32:20 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:20 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-1283462b-32f9-41c2-842f-014bff2534e2-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-1283462b-32f9-41c2-842f-014bff2534e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-quobyte-1283462b-32f9-41c2-842f-014bff2534e2" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-1283462b-32f9-41c2-842f-014bff2534e2" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb477eac-e830-46b7-88c6-409d14e7e76d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:20 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 Jul 21 17:32:20 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:20 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:20 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b 1G Jul 21 17:32:20 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:20 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:20 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2 Jul 21 17:32:20 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:20 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b 1G" returned: 0 in 0.400s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78515d7a-b7a2-460e-97de-fe2971b230c1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:20 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78515d7a-b7a2-460e-97de-fe2971b230c1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b Jul 21 17:32:20 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:21 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1283462b-32f9-41c2-842f-014bff2534e2" returned: 0 in 0.254s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-1283462b-32f9-41c2-842f-014bff2534e2" released by "delete_volume" :: held 0.678s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Created reservations ['33671729-8b73-4b2e-bda8-310a897c8fe4', 'fd120a31-a477-4c45-9c5a-4b3c483824cc', '29486b22-851b-4fd0-8be6-57a4008a85b8', 'a50362bd-f818-4e46-8899-202843144ccc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:21 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:21 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:21 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78515d7a-b7a2-460e-97de-fe2971b230c1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:21 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b is being set with open permissions: ugo+rw Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:21 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b Jul 21 17:32:21 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:21 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Deleted volume successfully. Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1adf54bb-de13-4285-b12b-ac561e05b7fc tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-1283462b-32f9-41c2-842f-014bff2534e2-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-40b6e885-6800-4576-873d-ea52f28e16cb-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:21 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-40b6e885-6800-4576-873d-ea52f28e16cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-quobyte-40b6e885-6800-4576-873d-ea52f28e16cb" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:21 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info Jul 21 17:32:21 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-40b6e885-6800-4576-873d-ea52f28e16cb" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f8ee96-e50c-4cc2-9571-13dc99a19211]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:21 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb Jul 21 17:32:21 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:21 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:21 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info is being set with open permissions: ugo+rw Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:21 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info Jul 21 17:32:21 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:21 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb" returned: 0 in 0.374s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:22 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb Jul 21 17:32:22 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:22 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.info" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.236s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Creating offline snapshot 3d30586b-3698-4111-99b1-7499ea5ebdd0 of volume 653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:32:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5180f22f-8917-41a7-bcb3-cee931921022 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Create snapshot completed successfully Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef9af8a-8615-4613-ae41-612e4417d4bd]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:22 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:22 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-40b6e885-6800-4576-873d-ea52f28e16cb" returned: 0 in 0.257s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:22 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-40b6e885-6800-4576-873d-ea52f28e16cb" released by "delete_volume" :: held 0.668s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Created reservations ['c0a5a9f0-247e-4926-a121-2ecf040e9ebf', 'c0936298-2c67-425c-b44e-65f6480e08fb', 'c1e3286d-ab03-4f87-b4c3-2b80a7c70e92', '0a2d719a-412c-4cfb-b9ca-c9a2c6663446'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:22 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:22 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:22 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.361s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:22 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 1G Jul 21 17:32:22 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-d6481e5c-61be-48d9-b14c-4c8b5fb7015b-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:22 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.294s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-d6481e5c-61be-48d9-b14c-4c8b5fb7015b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Deleted volume successfully. Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0d618c25-8b52-4e10-9fb2-794b9f93f6e6 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-40b6e885-6800-4576-873d-ea52f28e16cb-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-quobyte-d6481e5c-61be-48d9-b14c-4c8b5fb7015b" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-d6481e5c-61be-48d9-b14c-4c8b5fb7015b" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bef1eba-9b29-4955-932f-c41516695638]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:22 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b Jul 21 17:32:22 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:23 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 1G" returned: 0 in 0.553s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:23 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 Jul 21 17:32:23 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (a2ef9173-7027-461b-a169-cf56c1d6df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94109ae4-605f-469e-a682-3b2a06fa521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b" returned: 0 in 0.451s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94109ae4-605f-469e-a682-3b2a06fa521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1885069589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:23Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aceffd3-0937-4a9c-8292-4f04fa736b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aceffd3-0937-4a9c-8292-4f04fa736b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab28d7-edea-4838-9ddc-0f8b083bf121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab28d7-edea-4838-9ddc-0f8b083bf121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7', 'volume_name': 'volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60d6668-80bf-4580-bb09-fe4f141c3e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60d6668-80bf-4580-bb09-fe4f141c3e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e9db0f-861c-4749-a648-3d0386eb1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume 14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7', 'volume_size': 1} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:23 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0" returned: 0 in 0.398s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:23 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 is being set with open permissions: ugo+rw Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:23 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 Jul 21 17:32:23 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:23 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-d6481e5c-61be-48d9-b14c-4c8b5fb7015b" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-d6481e5c-61be-48d9-b14c-4c8b5fb7015b" released by "delete_volume" :: held 0.816s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (3f1c1290-80cf-401f-84ff-01809a186106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0af19ff-be23-4a53-886a-5d882e218754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0af19ff-be23-4a53-886a-5d882e218754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090737797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012f6500-4f23-4689-84a0-a308efde9c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:24Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba289d7-4c91-4fc8-9b19-137f96d59c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba289d7-4c91-4fc8-9b19-137f96d59c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e776cde4-4430-4783-955d-1a4042aa7551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e776cde4-4430-4783-955d-1a4042aa7551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012f6500-4f23-4689-84a0-a308efde9c73', 'volume_name': 'volume-012f6500-4f23-4689-84a0-a308efde9c73', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49430bf-f1f4-45cd-bc87-14fd54898312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49430bf-f1f4-45cd-bc87-14fd54898312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602788bf-ee7a-42fe-9d75-e93e9d0bbb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume 012f6500-4f23-4689-84a0-a308efde9c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012f6500-4f23-4689-84a0-a308efde9c73', 'volume_size': 1} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Created reservations ['eae282ee-433d-4eb2-abce-307d41d5b4a3', '10691a03-f0cd-4dc0-8214-ec138781d16f', '79e48716-ecd8-4183-b1b9-757dd50ab7eb', 'bf125da5-134a-49f1-b16d-a0b51a1bb24c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:23 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:23 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info Jul 21 17:32:23 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:23 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:23 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-8c856a21-618c-4c78-b310-3eb958349359-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-8c856a21-618c-4c78-b310-3eb958349359-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-quobyte-8c856a21-618c-4c78-b310-3eb958349359" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-8c856a21-618c-4c78-b310-3eb958349359" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56440c-b1d3-4cb3-b8e4-985ba262c6d6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:24 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:24 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (d8d0458c-bee0-411a-bee0-b530efa1d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c207639c-260a-4283-872f-8c4c61d25739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info" returned: 0 in 0.423s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:24 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info is being set with open permissions: ugo+rw Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c207639c-260a-4283-872f-8c4c61d25739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-381680883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b849a455-ccd2-4a60-9772-0dbb1ea54328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:24Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ed6d9d-521b-42e3-86d6-f0542e5e1a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info Jul 21 17:32:24 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ed6d9d-521b-42e3-86d6-f0542e5e1a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de980fcf-d770-4e62-9447-e5161b093be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de980fcf-d770-4e62-9447-e5161b093be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b849a455-ccd2-4a60-9772-0dbb1ea54328', 'volume_name': 'volume-b849a455-ccd2-4a60-9772-0dbb1ea54328', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bff20e3-ddbf-43d3-92aa-d7ac2288c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bff20e3-ddbf-43d3-92aa-d7ac2288c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 Jul 21 17:32:24 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4bbd25-e3c4-4f03-ae2c-497b2bcc5b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume b849a455-ccd2-4a60-9772-0dbb1ea54328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b849a455-ccd2-4a60-9772-0dbb1ea54328', 'volume_size': 1} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Deleted volume successfully. Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8356d431-9b1c-4065-a55f-908330e8ad21 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-d6481e5c-61be-48d9-b14c-4c8b5fb7015b-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:24 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.info" returned: 0 in 0.358s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.333s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97247eb-55d1-4251-9855-5fd0a4755349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4798a545a6a54578a1928f6d4ec5442a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:18Z,use_quota=True,user_id='06c6142fbe2b41a79bbabe59814c3c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b956c113-ce01-4c1d-a5c3-196bb9ccb4b3),volume_type_id=b956c113-ce01-4c1d-a5c3-196bb9ccb4b3)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Creating volume f97247eb-55d1-4251-9855-5fd0a4755349 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:24 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:24 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:24 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 1073741824 Jul 21 17:32:24 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359" returned: 0 in 0.541s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3b1c3406-43fa-4b74-b438-4d682abfa499 tempest-VolumeDependencyTests-1649611275 None] Create snapshot completed successfully Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:24 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359 Jul 21 17:32:24 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (9637970b-fd02-43e5-a477-b3cb5facaacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7faa8dc0-e987-4224-9990-f2db624a6623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7faa8dc0-e987-4224-9990-f2db624a6623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978388978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a99eacc-b513-4427-87c0-33229fe8592a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:25Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15684cc-bed4-4834-94bc-9820bfe9e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15684cc-bed4-4834-94bc-9820bfe9e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3248386e-cb65-49c4-82b6-3b062a5503f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3248386e-cb65-49c4-82b6-3b062a5503f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a99eacc-b513-4427-87c0-33229fe8592a', 'volume_name': 'volume-5a99eacc-b513-4427-87c0-33229fe8592a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733739e2-d832-4aa1-bfab-5908d7cb6def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733739e2-d832-4aa1-bfab-5908d7cb6def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4fabd7-b2d4-4d1a-a7be-50a2990703d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume 5a99eacc-b513-4427-87c0-33229fe8592a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a99eacc-b513-4427-87c0-33229fe8592a', 'volume_size': 1} Jul 21 17:32:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:25 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (f1342a93-1cbf-4e6e-81f7-0112f23981cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39edc0b-6d68-4945-a01b-24839437b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-8c856a21-618c-4c78-b310-3eb958349359" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39edc0b-6d68-4945-a01b-24839437b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615342375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e29d24e-736e-46bd-b3ba-afee5d1dc787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:25Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af71c54-f2c2-4b76-ad10-bf0ac454d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af71c54-f2c2-4b76-ad10-bf0ac454d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a33cd5-47fd-44f7-b509-64717f3045f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a33cd5-47fd-44f7-b509-64717f3045f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e29d24e-736e-46bd-b3ba-afee5d1dc787', 'volume_name': 'volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116b69e7-2f3f-45cc-a4b5-7d925ad9e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116b69e7-2f3f-45cc-a4b5-7d925ad9e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d994f3-aa40-464f-8696-b8f1547db552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume 4e29d24e-736e-46bd-b3ba-afee5d1dc787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787', 'volume_size': 1} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-8c856a21-618c-4c78-b310-3eb958349359" released by "delete_volume" :: held 1.023s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Created reservations ['dfef4c0f-5e06-44c9-af9d-843924628426', '10db2c9a-2a7b-46cf-b776-824ca996b318', '8edc8d78-7246-48b6-a71d-35e61d999199', 'd9f44fe5-634a-485c-8449-5b45a882b32b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:25 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 1073741824" returned: 0 in 0.542s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:25 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 Jul 21 17:32:25 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:25 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:25 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:25 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349" returned: 0 in 0.268s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1885069589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:23Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating volume 14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:25 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:25 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 1073741824 Jul 21 17:32:25 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Attempting download of 75362bcd-7cc8-4d69-b7c2-65e810a733ba ((None, [{'url': 'file:///opt/stack/data/glance/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'metadata': {}}])) to volume f97247eb-55d1-4251-9855-5fd0a4755349. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:32:25 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Deleted volume successfully. Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a549054-8773-4f7f-a045-c309762f664a]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-736ce0f5-e1a9-4d2a-b1a3-ad1daeacf457 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-8c856a21-618c-4c78-b310-3eb958349359-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:25 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul Jul 21 17:32:25 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Flow 'volume_create_manager' (fa853f7a-0442-43e9-aa1f-a0852e6ef3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4765103e-5819-4b79-b776-2c5482e18222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4765103e-5819-4b79-b776-2c5482e18222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-869650977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255622ca-f9b5-4f1b-9049-539dbf52ab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23465bd7c8ab409faf1072c9a9c8dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d30586b-3698-4111-99b1-7499ea5ebdd0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:26Z,use_quota=True,user_id='9cb3954178ca408f92b136d2f490e861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ed4198-9643-4008-9f5a-1751c0e89478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ed4198-9643-4008-9f5a-1751c0e89478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b543158f-9cad-40cd-b7e4-84ed7feb2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b543158f-9cad-40cd-b7e4-84ed7feb2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '255622ca-f9b5-4f1b-9049-539dbf52ab31', 'volume_name': 'volume-255622ca-f9b5-4f1b-9049-539dbf52ab31', 'volume_size': 1, 'snapshot_id': '3d30586b-3698-4111-99b1-7499ea5ebdd0'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0615ee1-d74e-45ae-a335-740fb1415992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0615ee1-d74e-45ae-a335-740fb1415992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8c79b4-6d8c-419c-9328-4dcaa3670b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Volume 255622ca-f9b5-4f1b-9049-539dbf52ab31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-255622ca-f9b5-4f1b-9049-539dbf52ab31', 'volume_size': 1, 'snapshot_id': '3d30586b-3698-4111-99b1-7499ea5ebdd0'} Jul 21 17:32:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:26 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul" returned: 0 in 0.363s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 1073741824" returned: 0 in 0.543s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 Jul 21 17:32:26 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul Jul 21 17:32:26 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-037310c9-88e7-4df7-9b7d-20f4ca0478bf-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-037310c9-88e7-4df7-9b7d-20f4ca0478bf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "cinder-quobyte-037310c9-88e7-4df7-9b7d-20f4ca0478bf" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-037310c9-88e7-4df7-9b7d-20f4ca0478bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d037db8b-8258-4ab6-afac-2bea828ac10f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:26 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.660s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090737797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012f6500-4f23-4689-84a0-a308efde9c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:24Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating volume 012f6500-4f23-4689-84a0-a308efde9c73 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:26 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul" returned: 1 in 0.364s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75362bcd-7cc8-4d69-b7c2-65e810a733ba_y38869ul' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25011b-a852-4f60-a911-f69a1715e52d]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 1073741824 Jul 21 17:32:26 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e9db0f-861c-4749-a648-3d0386eb1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a094e7-3a33-40e0-9197-ab83f940cc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:26 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 (14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7): created successfully Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a094e7-3a33-40e0-9197-ab83f940cc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (a2ef9173-7027-461b-a169-cf56c1d6df75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:26 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf Jul 21 17:32:26 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e8c8e042-05d0-44f4-9a25-717d6c2feebf tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created volume successfully. Jul 21 17:32:26 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD Jul 21 17:32:26 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 1073741824" returned: 0 in 0.509s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:26 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD Jul 21 17:32:26 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:26 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 Jul 21 17:32:26 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:27 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-037310c9-88e7-4df7-9b7d-20f4ca0478bf" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-quobyte-037310c9-88e7-4df7-9b7d-20f4ca0478bf" released by "delete_volume" :: held 0.735s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Created reservations ['2976c7c0-ac2b-46bc-bebd-f079133d26a1', '908e3d9f-3360-41d0-b5de-cbd8485fb39b', '5e9d549f-27dc-405c-ae98-97cbbfcc6dea', '87954312-fa29-4008-95d1-347d6cabc2da'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:27 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] 75362bcd-7cc8-4d69-b7c2-65e810a733ba was raw, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:27 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 Jul 21 17:32:27 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:27 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73" returned: 0 in 0.275s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-381680883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b849a455-ccd2-4a60-9772-0dbb1ea54328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:24Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating volume b849a455-ccd2-4a60-9772-0dbb1ea54328 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:27 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:27 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:27 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602788bf-ee7a-42fe-9d75-e93e9d0bbb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012f6500-4f23-4689-84a0-a308efde9c73', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:27 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 1073741824 Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebd7a56-b867-4ade-ac30-1971521e071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:27 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:27 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume volume-012f6500-4f23-4689-84a0-a308efde9c73 (012f6500-4f23-4689-84a0-a308efde9c73): created successfully Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebd7a56-b867-4ade-ac30-1971521e071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (3f1c1290-80cf-401f-84ff-01809a186106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-91e72179-76b6-4084-82e4-f9464b59c23b tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created volume successfully. Jul 21 17:32:27 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Deleted volume successfully. Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b6a52e-f24a-4670-9c56-a0b10bad4523 tempest-CreateVolumesFromImageTest-1978366784 None] Lock "cinder-037310c9-88e7-4df7-9b7d-20f4ca0478bf-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:27 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:27 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 1073741824" returned: 0 in 0.474s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349" returned: 0 in 0.543s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75362bcd-7cc8-4d69-b7c2-65e810a733ba_cnchpu94devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:32:27 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:27 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 1G Jul 21 17:32:27 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:27 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 Jul 21 17:32:27 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:28 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328" returned: 0 in 0.283s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978388978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a99eacc-b513-4427-87c0-33229fe8592a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:25Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating volume 5a99eacc-b513-4427-87c0-33229fe8592a {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:28 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:28 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 1G" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Downloaded image 75362bcd-7cc8-4d69-b7c2-65e810a733ba ((None, [{'url': 'file:///opt/stack/data/glance/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'metadata': {}}])) to volume f97247eb-55d1-4251-9855-5fd0a4755349 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Temporary image 75362bcd-7cc8-4d69-b7c2-65e810a733ba for user 06c6142fbe2b41a79bbabe59814c3c98 is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Marking volume f97247eb-55d1-4251-9855-5fd0a4755349 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:32:28 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a 1073741824 Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4bbd25-e3c4-4f03-ae2c-497b2bcc5b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b849a455-ccd2-4a60-9772-0dbb1ea54328', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:28 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149bfa3a-66dc-4814-9a25-8b0192864a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Copying metadata from image 75362bcd-7cc8-4d69-b7c2-65e810a733ba to f97247eb-55d1-4251-9855-5fd0a4755349. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Creating volume glance metadata for volume f97247eb-55d1-4251-9855-5fd0a4755349 backed by image 75362bcd-7cc8-4d69-b7c2-65e810a733ba with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd86906ce946a4fe4813dc05652366a16', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:32:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 (b849a455-ccd2-4a60-9772-0dbb1ea54328): created successfully Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149bfa3a-66dc-4814-9a25-8b0192864a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (d8d0458c-bee0-411a-bee0-b530efa1d0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a860c92f-3335-4041-b0d3-0dc98093e490 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created volume successfully. Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa4829-7190-4a4c-9cdd-ba4fdfb3a763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97247eb-55d1-4251-9855-5fd0a4755349', 'volume_size': 1, 'image_id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd86906ce946a4fe4813dc05652366a16', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4798a545a6a54578a1928f6d4ec5442a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f43fda7ca56aad659c5a2f28b3209d56c13bc69f8b88acf5a518c4d847d057feb3ca8ad372a4bb57c996c5af90bf2ed25e86262a2b932535c1e8145fd4fcec8d', 'id': '75362bcd-7cc8-4d69-b7c2-65e810a733ba', 'created_at': datetime.datetime(2026, 7, 21, 15, 32, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 32, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75362bcd-7cc8-4d69-b7c2-65e810a733ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33b34b4-6829-4e0c-b82f-29534cd2c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Volume volume-f97247eb-55d1-4251-9855-5fd0a4755349 (f97247eb-55d1-4251-9855-5fd0a4755349): created successfully Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33b34b4-6829-4e0c-b82f-29534cd2c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Flow 'volume_create_manager' (04f28a95-1ed3-456f-a3a9-c900de318cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f784f605-8922-4d85-8ca1-6e0b158b2f6f tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Created volume successfully. Jul 21 17:32:28 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a 1073741824" returned: 0 in 0.547s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:28 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a Jul 21 17:32:28 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:28 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615342375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e29d24e-736e-46bd-b3ba-afee5d1dc787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6c64fbc345407dbde772d5b079d5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:25Z,use_quota=True,user_id='b6a4e8890f2a4007969f6614b0e6be98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Creating volume 4e29d24e-736e-46bd-b3ba-afee5d1dc787 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:28 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Acquiring lock "cinder-f97247eb-55d1-4251-9855-5fd0a4755349-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4fabd7-b2d4-4d1a-a7be-50a2990703d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a99eacc-b513-4427-87c0-33229fe8592a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:28 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 1073741824 Jul 21 17:32:29 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd305827-7fe1-4d3b-8c3a-c17a679f940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "cinder-f97247eb-55d1-4251-9855-5fd0a4755349-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:29 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume volume-5a99eacc-b513-4427-87c0-33229fe8592a (5a99eacc-b513-4427-87c0-33229fe8592a): created successfully Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd305827-7fe1-4d3b-8c3a-c17a679f940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (9637970b-fd02-43e5-a477-b3cb5facaacf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-37f92507-6838-4071-b3cb-d4e0cf5d832d tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created volume successfully. Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Acquiring lock "cinder-quobyte-f97247eb-55d1-4251-9855-5fd0a4755349" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "cinder-quobyte-f97247eb-55d1-4251-9855-5fd0a4755349" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7396f37e-df05-4787-8376-f7daf354a6e4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:29 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 Jul 21 17:32:29 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:29 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 1073741824" returned: 0 in 0.576s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:29 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349" returned: 0 in 0.419s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:29 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349 Jul 21 17:32:29 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:29 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 Jul 21 17:32:29 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:29 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-f97247eb-55d1-4251-9855-5fd0a4755349" returned: 0 in 0.283s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:29 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787" returned: 0 in 0.256s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "cinder-quobyte-f97247eb-55d1-4251-9855-5fd0a4755349" released by "delete_volume" :: held 0.761s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.876s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-quobyte-3d30586b-3698-4111-99b1-7499ea5ebdd0-255622ca-f9b5-4f1b-9049-539dbf52ab31" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d994f3-aa40-464f-8696-b8f1547db552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31eb1be8-012b-464d-92be-04ab285c7d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-3d30586b-3698-4111-99b1-7499ea5ebdd0-255622ca-f9b5-4f1b-9049-539dbf52ab31" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Creating volume 255622ca-f9b5-4f1b-9049-539dbf52ab31 from snapshot 3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-quobyte-255622ca-f9b5-4f1b-9049-539dbf52ab31" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:29 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Volume volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 (4e29d24e-736e-46bd-b3ba-afee5d1dc787): created successfully Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31eb1be8-012b-464d-92be-04ab285c7d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Flow 'volume_create_manager' (f1342a93-1cbf-4e6e-81f7-0112f23981cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a23cfc88-3e7b-4212-8ffe-81be693372b9 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created volume successfully. Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-255622ca-f9b5-4f1b-9049-539dbf52ab31" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] snapshot: 3d30586b-3698-4111-99b1-7499ea5ebdd0, volume: 255622ca-f9b5-4f1b-9049-539dbf52ab31, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dc126f-4391-417b-91ce-e47bfc77739c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Created reservations ['2be99076-a64d-493f-9b54-456f92abdef0', 'cdddab44-44a9-4732-85d0-eae80ff4e6a4', '6df2ca76-8e2d-445f-acf7-7afeca8d62da', 'df464524-3cc1-4f2c-bdd8-6769b5a4ba28'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:30 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 Jul 21 17:32:30 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:30 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:30 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:30 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Deleted volume successfully. Jul 21 17:32:30 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0" returned: 0 in 0.444s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-23f5fc15-3a4c-4161-8eef-4dd2f688de2d tempest-VolumeAndVolumeTypeFromImageTest-919655746 None] Lock "cinder-f97247eb-55d1-4251-9855-5fd0a4755349-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b5905d-6465-4c7a-bc80-5bef133f0990]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:30 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:30 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-4e29d24e-736e-46bd-b3ba-afee5d1dc787-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-4e29d24e-736e-46bd-b3ba-afee5d1dc787-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-4e29d24e-736e-46bd-b3ba-afee5d1dc787" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-4e29d24e-736e-46bd-b3ba-afee5d1dc787" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d4961-63d0-4928-941b-9bbb6981c8f3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:30 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.505s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:31 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:31 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:31 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 Jul 21 17:32:31 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:31 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:31 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787 Jul 21 17:32:31 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:31 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4e29d24e-736e-46bd-b3ba-afee5d1dc787" returned: 0 in 0.589s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-4e29d24e-736e-46bd-b3ba-afee5d1dc787" released by "delete_volume" :: held 1.132s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['8f324914-906f-480c-b691-8c117b727046', 'a457eaa9-8423-42c5-84a5-5b1b199c3cd9', '863c9b2c-66fc-4d51-b72f-d5de749feb9c', '03685c40-e2cc-47e9-a871-6eb165e119fe'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:32 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:32 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:32 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.529s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:32 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleted volume successfully. Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8bc3ff1f-363c-4f5b-b4a8-f487b2f3c776 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-4e29d24e-736e-46bd-b3ba-afee5d1dc787-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-5a99eacc-b513-4427-87c0-33229fe8592a-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-5a99eacc-b513-4427-87c0-33229fe8592a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-5a99eacc-b513-4427-87c0-33229fe8592a" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-5a99eacc-b513-4427-87c0-33229fe8592a" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a8179-5e86-4990-9590-8bbb20c76bda]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:33 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a Jul 21 17:32:33 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:34 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a" returned: 0 in 0.720s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:34 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a Jul 21 17:32:34 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:35 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a99eacc-b513-4427-87c0-33229fe8592a" returned: 0 in 0.689s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-5a99eacc-b513-4427-87c0-33229fe8592a" released by "delete_volume" :: held 1.571s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['56a44064-8fd9-41c7-bb34-9225dc07a9df', '7a78aa6d-4d5b-45d1-bc2b-a5ef425e7aac', '096c41fc-c2b6-4e39-92c4-150cd32311da', '06f20fe1-faee-4891-82e8-31cdb60df362'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:35 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:35 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-b849a455-ccd2-4a60-9772-0dbb1ea54328-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-b849a455-ccd2-4a60-9772-0dbb1ea54328-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:36 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-b849a455-ccd2-4a60-9772-0dbb1ea54328" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.765s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:36 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleted volume successfully. Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-b849a455-ccd2-4a60-9772-0dbb1ea54328" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67144994-3aa1-4af0-86b3-908bdada0406 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-5a99eacc-b513-4427-87c0-33229fe8592a-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5124d83-1fda-4b95-83ed-d7bba874febb]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:36 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 Jul 21 17:32:36 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:36 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328" returned: 0 in 0.670s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:37 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328 Jul 21 17:32:37 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:37 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31" returned: 0 in 6.170s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00a9fa3-f4e9-414d-832a-4127abe2ab53]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:37 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:37 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:37 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b849a455-ccd2-4a60-9772-0dbb1ea54328" returned: 0 in 0.469s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-b849a455-ccd2-4a60-9772-0dbb1ea54328" released by "delete_volume" :: held 1.234s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['c299ab37-4a4e-4de1-ae51-53637cf89394', '528678ec-5291-4c67-839e-a7949fa0e564', '8beb1bde-5ca8-4dac-9c5c-b26adc609ff9', 'f83544b6-eeea-486b-8555-fb7ca0776d75'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:37 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:37 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:37 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.661s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:32:37 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Converted 1024.00 MB image at 165.91 MB/s Jul 21 17:32:37 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 is being set with open permissions: ugo+rw Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:37 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.306s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleted volume successfully. Jul 21 17:32:37 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 Jul 21 17:32:37 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:37 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3d73016c-0914-4e05-92e0-1dde74803235 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-b849a455-ccd2-4a60-9772-0dbb1ea54328-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:38 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-255622ca-f9b5-4f1b-9049-539dbf52ab31" released by "_copy_volume_from_snapshot" :: held 8.189s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-3d30586b-3698-4111-99b1-7499ea5ebdd0-255622ca-f9b5-4f1b-9049-539dbf52ab31" released by "_create_volume_from_snapshot" :: held 8.247s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.285s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8c79b4-6d8c-419c-9328-4dcaa3670b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255622ca-f9b5-4f1b-9049-539dbf52ab31', 'volume_size': 1, 'snapshot_id': '3d30586b-3698-4111-99b1-7499ea5ebdd0'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4502252-1338-472f-9909-2012733763a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:38 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Volume volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 (255622ca-f9b5-4f1b-9049-539dbf52ab31): created successfully Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4502252-1338-472f-9909-2012733763a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Flow 'volume_create_manager' (fa853f7a-0442-43e9-aa1f-a0852e6ef3ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:38 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-de10b5ac-5fc0-4058-bf24-d3d50883962c tempest-VolumeDependencyTests-1649611275 None] Created volume successfully. Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-012f6500-4f23-4689-84a0-a308efde9c73-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-012f6500-4f23-4689-84a0-a308efde9c73-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-012f6500-4f23-4689-84a0-a308efde9c73" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-012f6500-4f23-4689-84a0-a308efde9c73" acquired by "delete_volume" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6c096d-20c2-46f0-9a0f-1e6f38383875]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:38 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 Jul 21 17:32:38 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:38 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73" returned: 0 in 0.395s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:38 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73 Jul 21 17:32:38 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (18883daa-2b08-4e19-9871-d4ee1b8b45da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10492f33-b878-4566-a662-4e218bcc48e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10492f33-b878-4566-a662-4e218bcc48e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033711942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f415827-f3ee-454d-9698-71aadcd026f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:39Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb8a23d-f6bd-4d34-be2f-a4e10fc286ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb8a23d-f6bd-4d34-be2f-a4e10fc286ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6555f4-9462-4a22-9aa6-ab25cd5a7e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6555f4-9462-4a22-9aa6-ab25cd5a7e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f415827-f3ee-454d-9698-71aadcd026f8', 'volume_name': 'volume-9f415827-f3ee-454d-9698-71aadcd026f8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09a7975-537e-4685-8e15-34859c1c367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09a7975-537e-4685-8e15-34859c1c367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272d67c0-14ae-4d75-a369-940e76076c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:39 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume 9f415827-f3ee-454d-9698-71aadcd026f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f415827-f3ee-454d-9698-71aadcd026f8', 'volume_size': 1} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033711942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f415827-f3ee-454d-9698-71aadcd026f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:39Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Creating volume 9f415827-f3ee-454d-9698-71aadcd026f8 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:39 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:39 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 1073741824 Jul 21 17:32:39 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:39 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-012f6500-4f23-4689-84a0-a308efde9c73" returned: 0 in 0.270s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-012f6500-4f23-4689-84a0-a308efde9c73" released by "delete_volume" :: held 0.717s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['69e5727f-cbd2-49eb-a02a-146ac70089c8', '7f319db0-26a3-4a6f-8fbf-9747076348aa', '95506e01-e9ef-44c9-a701-45a906b22099', '7ae6047e-e3cd-4830-9595-1b18f74f324a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-3d30586b-3698-4111-99b1-7499ea5ebdd0-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-3d30586b-3698-4111-99b1-7499ea5ebdd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-quobyte-653d5f03-b78f-4722-a32e-87b1a0c63ee0" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:39 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-653d5f03-b78f-4722-a32e-87b1a0c63ee0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-quobyte-3d30586b-3698-4111-99b1-7499ea5ebdd0" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:39 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-3d30586b-3698-4111-99b1-7499ea5ebdd0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Deleting offline snapshot 3d30586b-3698-4111-99b1-7499ea5ebdd0 of volume 653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] snapshot_file for this snap is: volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3dd08-cf8c-4e12-8452-cfb4431ab0d7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:39 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:39 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:39 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 1073741824" returned: 0 in 0.575s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:39 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleted volume successfully. Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7" acquired by "delete_volume" :: waited 0.048s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:39 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 Jul 21 17:32:39 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc2b93-42c1-4604-a9f2-3ae266634759]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d30fb1e8-44f4-46b6-bd55-df750f1f961f tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-012f6500-4f23-4689-84a0-a308efde9c73-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:39 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 Jul 21 17:32:39 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:40 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0" returned: 0 in 0.517s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d086d-e29b-4de3-af96-de74bc874a58]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:40 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272d67c0-14ae-4d75-a369-940e76076c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f415827-f3ee-454d-9698-71aadcd026f8', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5887ea29-6ff0-436f-86c3-1c5b2d6030b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:40 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume volume-9f415827-f3ee-454d-9698-71aadcd026f8 (9f415827-f3ee-454d-9698-71aadcd026f8): created successfully Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5887ea29-6ff0-436f-86c3-1c5b2d6030b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (18883daa-2b08-4e19-9871-d4ee1b8b45da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-80dd28ad-7709-49aa-8e5f-163570d7c297 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created volume successfully. Jul 21 17:32:40 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:40 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:40 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7" returned: 0 in 0.424s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:40 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7 Jul 21 17:32:40 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:40 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.398s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:40 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 Jul 21 17:32:40 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:40 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7" returned: 0 in 0.277s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7" released by "delete_volume" :: held 0.760s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['c8047e42-d529-475d-a096-2637c38df6a1', 'b344d1d3-e4aa-4cf2-b055-0d304c62a09c', '60bd8a9b-5578-4319-abba-6bb6c160602f', 'c4db24d0-a3bb-4f1d-9fb0-09d03e7a687a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:40 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:40 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-8709dc02-eebb-4114-996e-60da1255ba9b-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-8709dc02-eebb-4114-996e-60da1255ba9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-78515d7a-b7a2-460e-97de-fe2971b230c1" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:40 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-78515d7a-b7a2-460e-97de-fe2971b230c1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-8709dc02-eebb-4114-996e-60da1255ba9b" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0" returned: 0 in 0.447s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-8709dc02-eebb-4114-996e-60da1255ba9b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleting offline snapshot 8709dc02-eebb-4114-996e-60da1255ba9b of volume 78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:32:40 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0 Jul 21 17:32:40 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] snapshot_file for this snap is: volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1937c28b-b800-4f23-8891-7c1425718ad9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:40 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.299s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:40 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:40 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleted volume successfully. Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a9408b70-6f7f-41ba-87a5-fb1e0150e54e tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-14e3e2a4-1805-4f7f-ae71-06ea05b0d0d7-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:41 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b Jul 21 17:32:41 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:41 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0.3d30586b-3698-4111-99b1-7499ea5ebdd0" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-3d30586b-3698-4111-99b1-7499ea5ebdd0" released by "_delete_snapshot" :: held 1.764s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-653d5f03-b78f-4722-a32e-87b1a0c63ee0" released by "delete_snapshot" :: held 1.801s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Created reservations ['5bfa3f4c-a825-4155-897b-f5e66a231b97', '568b28ca-f91f-4fb6-bb2f-76da5d18c8e8', '978240c1-cbe6-4749-99ad-04ca88c85c89', 'a92ca8db-eaca-4fc0-90bc-4f1a1f315a9b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Delete snapshot completed successfully. Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-ac53f74f-0485-4e57-9a3a-ce55ef5f08e0 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-3d30586b-3698-4111-99b1-7499ea5ebdd0-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:41 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78515d7a-b7a2-460e-97de-fe2971b230c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f782969e-6ecb-4291-910a-9c93146c9fbc]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-653d5f03-b78f-4722-a32e-87b1a0c63ee0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-653d5f03-b78f-4722-a32e-87b1a0c63ee0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:41 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 Jul 21 17:32:41 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-quobyte-653d5f03-b78f-4722-a32e-87b1a0c63ee0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-653d5f03-b78f-4722-a32e-87b1a0c63ee0" acquired by "delete_volume" :: waited 0.051s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a091a-b30c-4d9b-944d-ca9cbd6e64c4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (108fd878-3e1d-46ea-8422-0978ec5d3f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04d9218-3f01-444d-8606-875f59e6c979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:42 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:42 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:42 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:42 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:42 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04d9218-3f01-444d-8606-875f59e6c979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-290514776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa7ff7f-2e46-4933-aa3b-80855c492d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:42Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da0cb68-b467-4897-bdab-25b89f57402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da0cb68-b467-4897-bdab-25b89f57402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2b3b18-4ae8-47a7-8458-ca57e7052fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2b3b18-4ae8-47a7-8458-ca57e7052fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa7ff7f-2e46-4933-aa3b-80855c492d7a', 'volume_name': 'volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2271e62-8275-4df8-a5a2-031eb715c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2271e62-8275-4df8-a5a2-031eb715c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f1cfc0-873e-47ca-b347-9e1dad8d7361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume 0fa7ff7f-2e46-4933-aa3b-80855c492d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a', 'volume_size': 1} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-290514776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa7ff7f-2e46-4933-aa3b-80855c492d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:42Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Creating volume 0fa7ff7f-2e46-4933-aa3b-80855c492d7a {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:42 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1" returned: 0 in 0.856s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:42 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a 1073741824 Jul 21 17:32:42 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:42 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b Jul 21 17:32:42 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (42acb605-1fc2-4d9f-bb84-1fbdbea7068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dcaa69-0bda-4444-bb2f-a002c3664cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dcaa69-0bda-4444-bb2f-a002c3664cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441733400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13c757e-3071-43b4-bdb5-f79cab2e688f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:42Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d338343-52cb-4cad-b093-a130ced0d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d338343-52cb-4cad-b093-a130ced0d15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6d0dca-aa8d-45c3-844b-d78c9ad87a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6d0dca-aa8d-45c3-844b-d78c9ad87a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13c757e-3071-43b4-bdb5-f79cab2e688f', 'volume_name': 'volume-b13c757e-3071-43b4-bdb5-f79cab2e688f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72656bd-40a3-4a25-85c5-0734feaa21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72656bd-40a3-4a25-85c5-0734feaa21da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e3a30e-f4b6-4740-ac0c-eaf339b45796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume b13c757e-3071-43b4-bdb5-f79cab2e688f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13c757e-3071-43b4-bdb5-f79cab2e688f', 'volume_size': 1} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:42 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.637s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:42 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.813s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:42 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0 Jul 21 17:32:42 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (8f9b812a-9bb5-46f9-a820-a0cd1eba4902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f148ae5f-62a9-48c5-9e1e-6619bb92800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:42 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f148ae5f-62a9-48c5-9e1e-6619bb92800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9304777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7b9c15-848b-4594-b406-fc3bff64de71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:43Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c315e5d9-6a94-43c6-9ea5-0cba5ba9473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c315e5d9-6a94-43c6-9ea5-0cba5ba9473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7397c606-dcef-4473-9d1d-fede5c26cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7397c606-dcef-4473-9d1d-fede5c26cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7b9c15-848b-4594-b406-fc3bff64de71', 'volume_name': 'volume-4c7b9c15-848b-4594-b406-fc3bff64de71', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fdebbb-8992-4a8d-9025-ff407438d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fdebbb-8992-4a8d-9025-ff407438d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee65ebc-6e64-4b28-b2f5-d851bcd09472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume 4c7b9c15-848b-4594-b406-fc3bff64de71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7b9c15-848b-4594-b406-fc3bff64de71', 'volume_size': 1} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b" returned: 0 in 0.710s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:43 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b Jul 21 17:32:43 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:43 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a 1073741824" returned: 0 in 0.819s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:43 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a Jul 21 17:32:43 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:43 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-653d5f03-b78f-4722-a32e-87b1a0c63ee0" returned: 0 in 0.525s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-653d5f03-b78f-4722-a32e-87b1a0c63ee0" released by "delete_volume" :: held 1.470s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Created reservations ['eae018b6-7e5b-49a5-ae6c-aa22b71caff0', 'c9056e84-7a75-4c90-8949-c15fd4181b7c', '5850b236-4e27-41b6-9263-4c99c71fdfcc', '9a023e26-c59d-4ff4-98ab-9364b7368e40'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:43 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (08a65aea-8d3b-4d4c-ac9a-67ab831a2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2cd63b-a60e-4f56-8ec3-c084444d7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1.8709dc02-eebb-4114-996e-60da1255ba9b" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2cd63b-a60e-4f56-8ec3-c084444d7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190317536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5edd7a1-055e-4dd0-83fb-56498db7ac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:43Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ec538b-f9c8-408d-b1a0-09406bb78083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ec538b-f9c8-408d-b1a0-09406bb78083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9d05f9-399e-4fa9-9ecd-bca98b7c8faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9d05f9-399e-4fa9-9ecd-bca98b7c8faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5edd7a1-055e-4dd0-83fb-56498db7ac46', 'volume_name': 'volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3edbb4f-e73c-4f60-b02c-3f981575805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3edbb4f-e73c-4f60-b02c-3f981575805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f075e5-515d-46b9-8eb3-9646e7356b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume e5edd7a1-055e-4dd0-83fb-56498db7ac46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46', 'volume_size': 1} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a" returned: 0 in 0.449s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441733400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13c757e-3071-43b4-bdb5-f79cab2e688f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:42Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Creating volume b13c757e-3071-43b4-bdb5-f79cab2e688f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:43 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:43 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f 1073741824 Jul 21 17:32:43 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f1cfc0-873e-47ca-b347-9e1dad8d7361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c1668d-1a44-4edd-bd62-daf2f1fa4b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-8709dc02-eebb-4114-996e-60da1255ba9b" released by "_delete_snapshot" :: held 2.815s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-78515d7a-b7a2-460e-97de-fe2971b230c1" released by "delete_snapshot" :: held 2.857s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:43 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a (0fa7ff7f-2e46-4933-aa3b-80855c492d7a): created successfully Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c1668d-1a44-4edd-bd62-daf2f1fa4b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (108fd878-3e1d-46ea-8422-0978ec5d3f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b6797d77-7eb1-4efe-80b3-0d0cc1b54104 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created volume successfully. Jul 21 17:32:43 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:43 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['979e5af6-257f-4d40-a5d9-38573527c08e', '2253a44d-f5b2-415e-bfe1-8969890d2f18', '5fcfceeb-bde3-412c-be3f-7475eba9cc1d', '413179fc-d6bd-409f-928f-41220821d75f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Delete snapshot completed successfully. Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42109415-31ea-4228-89e7-fc1dbc11d0bb tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-8709dc02-eebb-4114-996e-60da1255ba9b-delete_snapshot" released by "delete_snapshot" :: held 3.149s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-78515d7a-b7a2-460e-97de-fe2971b230c1-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (1e229450-0a80-46a7-a59c-0c833143333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4453cb07-6547-46ea-961d-252322bfdf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-78515d7a-b7a2-460e-97de-fe2971b230c1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4453cb07-6547-46ea-961d-252322bfdf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1363810404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710b7828-0b99-46af-affe-fc9a83628924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:44Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66606025-5b13-4bb1-9f70-3b8425983108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66606025-5b13-4bb1-9f70-3b8425983108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb88fff-a6fd-4f9f-9c31-a265d2380fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb88fff-a6fd-4f9f-9c31-a265d2380fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710b7828-0b99-46af-affe-fc9a83628924', 'volume_name': 'volume-710b7828-0b99-46af-affe-fc9a83628924', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75eacedb-0157-410a-94c7-992aec3662d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75eacedb-0157-410a-94c7-992aec3662d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e48f79-2a80-415e-905c-24cda496977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:44 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume 710b7828-0b99-46af-affe-fc9a83628924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710b7828-0b99-46af-affe-fc9a83628924', 'volume_size': 1} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-255622ca-f9b5-4f1b-9049-539dbf52ab31-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:44 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.523s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Deleted volume successfully. Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-255622ca-f9b5-4f1b-9049-539dbf52ab31-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "cinder-quobyte-78515d7a-b7a2-460e-97de-fe2971b230c1" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-2fe54dd8-5dd4-4ffc-9f01-c36da3261831 tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-653d5f03-b78f-4722-a32e-87b1a0c63ee0-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-78515d7a-b7a2-460e-97de-fe2971b230c1" acquired by "delete_volume" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:44 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f 1073741824" returned: 0 in 0.752s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "cinder-quobyte-255622ca-f9b5-4f1b-9049-539dbf52ab31" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8596671-a668-453c-b234-ef2cfcb29c7a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-255622ca-f9b5-4f1b-9049-539dbf52ab31" acquired by "delete_volume" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e54ea5b-a666-447e-995e-5603027ccc8c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:44 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f Jul 21 17:32:44 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:44 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 Jul 21 17:32:44 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:44 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 Jul 21 17:32:44 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:44 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f" returned: 0 in 0.294s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9304777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7b9c15-848b-4594-b406-fc3bff64de71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:43Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Creating volume 4c7b9c15-848b-4594-b406-fc3bff64de71 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:44 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:44 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1" returned: 0 in 0.455s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:44 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 1073741824 Jul 21 17:32:44 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e3a30e-f4b6-4740-ac0c-eaf339b45796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13c757e-3071-43b4-bdb5-f79cab2e688f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:44 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1 Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38978fe-d720-405d-bfd4-4c3615332f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:44 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:44 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume volume-b13c757e-3071-43b4-bdb5-f79cab2e688f (b13c757e-3071-43b4-bdb5-f79cab2e688f): created successfully Jul 21 17:32:44 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38978fe-d720-405d-bfd4-4c3615332f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (42acb605-1fc2-4d9f-bb84-1fbdbea7068e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31" returned: 0 in 0.459s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-936edeab-8818-4399-b0e0-148e4cb9f216 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created volume successfully. Jul 21 17:32:45 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31 Jul 21 17:32:45 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:45 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-78515d7a-b7a2-460e-97de-fe2971b230c1" returned: 0 in 0.343s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-quobyte-78515d7a-b7a2-460e-97de-fe2971b230c1" released by "delete_volume" :: held 0.883s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:45 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-255622ca-f9b5-4f1b-9049-539dbf52ab31" returned: 0 in 0.355s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-quobyte-255622ca-f9b5-4f1b-9049-539dbf52ab31" released by "delete_volume" :: held 0.884s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Created reservations ['e5ebb29c-dad0-466e-836f-4f7fdbc0022d', '64e9687c-5dd8-4f47-b3d1-d3adcb302d19', '6f150dbd-6a56-464a-a27d-47747514d0fd', 'e36f13ff-44df-47fc-87b2-56283ecf8352'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Created reservations ['5db4eec2-204c-4552-b926-cdd6ff51f9da', '71af411f-0a12-4425-99c0-7e6b4c204131', '178c3ee7-b3af-404f-8b4b-b1ddfe555926', '8606fd3d-0e84-47a4-84f9-9c1c2be13d72'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:45 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 1073741824" returned: 0 in 0.600s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:45 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:45 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:45 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 Jul 21 17:32:45 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:45 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:45 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:45 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.282s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Deleted volume successfully. Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5e51861c-ac42-418b-a3ff-fe505d5488b6 tempest-CreateVolumesFromSnapshotTest-1112177248 None] Lock "cinder-78515d7a-b7a2-460e-97de-fe2971b230c1-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:45 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.218s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190317536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5edd7a1-055e-4dd0-83fb-56498db7ac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:43Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Creating volume e5edd7a1-055e-4dd0-83fb-56498db7ac46 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:45 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee65ebc-6e64-4b28-b2f5-d851bcd09472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7b9c15-848b-4594-b406-fc3bff64de71', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a0292-81b4-4b70-8392-03fd0341a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:45 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:45 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 1073741824 Jul 21 17:32:45 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.277s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Deleted volume successfully. Jul 21 17:32:45 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume volume-4c7b9c15-848b-4594-b406-fc3bff64de71 (4c7b9c15-848b-4594-b406-fc3bff64de71): created successfully Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a0292-81b4-4b70-8392-03fd0341a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (8f9b812a-9bb5-46f9-a820-a0cd1eba4902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4eb52c3f-3369-4e8e-b598-ea9e13c18efe tempest-VolumeDependencyTests-1649611275 None] Lock "cinder-255622ca-f9b5-4f1b-9049-539dbf52ab31-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-efd0289a-50e0-48f9-bd7d-e8b4666bb149 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created volume successfully. Jul 21 17:32:46 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 1073741824" returned: 0 in 0.456s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:46 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 Jul 21 17:32:46 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Flow 'volume_create_manager' (b9407ab0-6109-45eb-a0df-84263ce6ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c73a68-6c9f-4c3f-9eb4-1908bf289f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c73a68-6c9f-4c3f-9eb4-1908bf289f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808577828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef25b4f-caa9-452f-a935-0b520f765490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28690e53f93743cd9e42b64970cb4835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:46Z,use_quota=True,user_id='15309c17df6c44d7a8cea686aed0b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58e054d-8c50-48bd-b39e-d05de1ee2ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58e054d-8c50-48bd-b39e-d05de1ee2ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73bbfc5-d7d0-466c-82a2-ca84c93d0dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73bbfc5-d7d0-466c-82a2-ca84c93d0dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef25b4f-caa9-452f-a935-0b520f765490', 'volume_name': 'volume-6ef25b4f-caa9-452f-a935-0b520f765490', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0028159e-93ba-4138-996c-b5040adc4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0028159e-93ba-4138-996c-b5040adc4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863bf95c-42c8-43f2-a1d7-cd0303bb634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:46 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Volume 6ef25b4f-caa9-452f-a935-0b520f765490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef25b4f-caa9-452f-a935-0b520f765490', 'volume_size': 1} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:46 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46" returned: 0 in 0.333s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.406s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1363810404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710b7828-0b99-46af-affe-fc9a83628924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20322d8772649c09a46e697253491ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:44Z,use_quota=True,user_id='48d35d42f1a04c46af1c20213ed89030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Creating volume 710b7828-0b99-46af-affe-fc9a83628924 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:46 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f075e5-515d-46b9-8eb3-9646e7356b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3649bf5f-8760-4c27-ad8c-32c0f7510a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:46 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 1073741824 Jul 21 17:32:46 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:46 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 (e5edd7a1-055e-4dd0-83fb-56498db7ac46): created successfully Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3649bf5f-8760-4c27-ad8c-32c0f7510a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:46 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (08a65aea-8d3b-4d4c-ac9a-67ab831a2029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:46 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a17f9128-a79d-4c01-a3e9-abfef4f8c54a tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created volume successfully. Jul 21 17:32:47 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 1073741824" returned: 0 in 0.519s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:47 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 Jul 21 17:32:47 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:47 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924" returned: 0 in 0.440s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808577828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef25b4f-caa9-452f-a935-0b520f765490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28690e53f93743cd9e42b64970cb4835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:46Z,use_quota=True,user_id='15309c17df6c44d7a8cea686aed0b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Creating volume 6ef25b4f-caa9-452f-a935-0b520f765490 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:47 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:47 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 1073741824 Jul 21 17:32:47 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e48f79-2a80-415e-905c-24cda496977c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710b7828-0b99-46af-affe-fc9a83628924', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b760ac1d-7d88-429d-a063-88df0b362051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:47 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Volume volume-710b7828-0b99-46af-affe-fc9a83628924 (710b7828-0b99-46af-affe-fc9a83628924): created successfully Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b760ac1d-7d88-429d-a063-88df0b362051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Flow 'volume_create_manager' (1e229450-0a80-46a7-a59c-0c833143333e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-840c30db-34f1-4dcf-ad50-1f530e1f3b38 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created volume successfully. Jul 21 17:32:48 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 1073741824" returned: 0 in 0.515s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:48 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 Jul 21 17:32:48 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:48 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490" returned: 0 in 0.299s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863bf95c-42c8-43f2-a1d7-cd0303bb634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef25b4f-caa9-452f-a935-0b520f765490', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c13ead-b852-4ad7-8b98-ff4c5f4891fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Volume volume-6ef25b4f-caa9-452f-a935-0b520f765490 (6ef25b4f-caa9-452f-a935-0b520f765490): created successfully Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c13ead-b852-4ad7-8b98-ff4c5f4891fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Flow 'volume_create_manager' (b9407ab0-6109-45eb-a0df-84263ce6ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c82d7a82-c606-4596-9ae6-ef57b670688d tempest-ProjectReaderTests-215108973 None] Created volume successfully. Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-710b7828-0b99-46af-affe-fc9a83628924-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-710b7828-0b99-46af-affe-fc9a83628924-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-quobyte-710b7828-0b99-46af-affe-fc9a83628924" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-710b7828-0b99-46af-affe-fc9a83628924" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77a46f0-b914-4cce-b485-46725d0cddff]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:49 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 Jul 21 17:32:49 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:49 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:49 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924 Jul 21 17:32:49 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:49 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-710b7828-0b99-46af-affe-fc9a83628924" returned: 0 in 0.281s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-710b7828-0b99-46af-affe-fc9a83628924" released by "delete_volume" :: held 0.706s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created reservations ['483279a3-794c-40b9-a96e-588c0f710ef2', 'b51a5b2d-f907-4b92-ac5a-bef7282a2c15', 'b7c5d909-3bd7-4e0d-8b53-07e28bc42a1c', '6f1c3bca-67f9-4889-a25f-39dee8d235e8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:49 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:49 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Acquiring lock "cinder-6ef25b4f-caa9-452f-a935-0b520f765490-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-e5edd7a1-055e-4dd0-83fb-56498db7ac46-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Lock "cinder-6ef25b4f-caa9-452f-a935-0b520f765490-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:50 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.323s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-e5edd7a1-055e-4dd0-83fb-56498db7ac46-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:50 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Deleted volume successfully. Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Acquiring lock "cinder-quobyte-6ef25b4f-caa9-452f-a935-0b520f765490" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31e94b7a-137f-4c3b-acb8-c5618d668823 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-710b7828-0b99-46af-affe-fc9a83628924-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-quobyte-e5edd7a1-055e-4dd0-83fb-56498db7ac46" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Lock "cinder-quobyte-6ef25b4f-caa9-452f-a935-0b520f765490" acquired by "delete_volume" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-e5edd7a1-055e-4dd0-83fb-56498db7ac46" acquired by "delete_volume" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b09114-4f58-4b41-bdc5-354abe426a23]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[963f6778-1ced-4ae3-b0fc-9156308045b9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:50 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 Jul 21 17:32:50 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:50 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 Jul 21 17:32:50 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:50 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46" returned: 0 in 0.440s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:50 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46 Jul 21 17:32:50 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:50 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490" returned: 0 in 0.522s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:50 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490 Jul 21 17:32:50 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:51 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6ef25b4f-caa9-452f-a935-0b520f765490" returned: 0 in 0.281s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:51 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Lock "cinder-quobyte-6ef25b4f-caa9-452f-a935-0b520f765490" released by "delete_volume" :: held 0.883s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (c1583945-a5d3-491a-872d-39b234e0ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1627468-236e-4ba3-bfd5-49eced78ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-e5edd7a1-055e-4dd0-83fb-56498db7ac46" returned: 0 in 0.403s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-e5edd7a1-055e-4dd0-83fb-56498db7ac46" released by "delete_volume" :: held 0.898s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1627468-236e-4ba3-bfd5-49eced78ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128725876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c0606c-be2c-4733-9369-ce9899c49963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:51Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b78e8c-cbe7-4009-9b59-20b182210d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b78e8c-cbe7-4009-9b59-20b182210d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb12f53-9907-48d9-8110-acfa7566cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb12f53-9907-48d9-8110-acfa7566cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c0606c-be2c-4733-9369-ce9899c49963', 'volume_name': 'volume-06c0606c-be2c-4733-9369-ce9899c49963', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d523da3-d832-43b3-aaa6-f24cd3d56486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d523da3-d832-43b3-aaa6-f24cd3d56486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae00407-5206-4946-81e3-324005165b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:51 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Volume 06c0606c-be2c-4733-9369-ce9899c49963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c0606c-be2c-4733-9369-ce9899c49963', 'volume_size': 1} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128725876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c0606c-be2c-4733-9369-ce9899c49963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:51Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Creating volume 06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:51 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:51 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 1073741824 Jul 21 17:32:51 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Created reservations ['d590623f-53ce-4c26-bc5b-47b13efbc565', 'b866c092-5213-4673-8c0d-6ed584a92848', '1dc7316b-9161-48c3-9efb-11b5c5749518', '5f24a552-640d-4386-a4a0-9e1b74401030'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created reservations ['ac029c9c-082f-4202-b4c0-96670311d6f4', '8573ce69-90ca-4527-b825-e1b17ecca04e', '8197f999-fb6a-42a6-81d0-e95854e744de', '1f20ec6e-0370-4952-9743-18699a50721b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:51 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:51 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:51 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:51 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:51 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.307s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:51 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Deleted volume successfully. Jul 21 17:32:51 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 1073741824" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:51 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-288eca50-60df-442d-a4b5-20e112d98157 tempest-ProjectReaderTests-215108973 None] Lock "cinder-6ef25b4f-caa9-452f-a935-0b520f765490-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:51 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Deleted volume successfully. Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:51 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-7c09c4ae-41ff-4ebf-ae9d-8fe8415fc11d tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-e5edd7a1-055e-4dd0-83fb-56498db7ac46-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:51 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 Jul 21 17:32:51 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:52 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963" returned: 0 in 0.259s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae00407-5206-4946-81e3-324005165b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c0606c-be2c-4733-9369-ce9899c49963', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882f72b9-ae84-4d06-ba2f-60c8e38accd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:52 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Volume volume-06c0606c-be2c-4733-9369-ce9899c49963 (06c0606c-be2c-4733-9369-ce9899c49963): created successfully Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882f72b9-ae84-4d06-ba2f-60c8e38accd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (c1583945-a5d3-491a-872d-39b234e0ed62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3522dfd3-e1ce-45a4-9162-d06ee6d1d45a tempest-ProjectReaderTests-462039180 None] Created volume successfully. Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-4c7b9c15-848b-4594-b406-fc3bff64de71-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-4c7b9c15-848b-4594-b406-fc3bff64de71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-quobyte-4c7b9c15-848b-4594-b406-fc3bff64de71" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-4c7b9c15-848b-4594-b406-fc3bff64de71" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c878da-6149-43a8-b08f-65d7c3d3b361]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:52 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 Jul 21 17:32:52 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:52 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Flow 'volume_create_manager' (0da30f44-4cdd-4fbc-ac74-db0aa15f5f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7f313e-15b0-4377-918a-12be04534f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71" returned: 0 in 0.441s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7f313e-15b0-4377-918a-12be04534f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-616769932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2927f8cc-7de9-47f1-9a0c-26749555e444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28690e53f93743cd9e42b64970cb4835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:53Z,use_quota=True,user_id='15309c17df6c44d7a8cea686aed0b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:52 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71 Jul 21 17:32:52 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8e9b9f-e889-4e82-bbf6-1d06fc559f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8e9b9f-e889-4e82-bbf6-1d06fc559f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9155e219-e1bf-4efa-8b50-805af809256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9155e219-e1bf-4efa-8b50-805af809256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2927f8cc-7de9-47f1-9a0c-26749555e444', 'volume_name': 'volume-2927f8cc-7de9-47f1-9a0c-26749555e444', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a741ea44-a5e2-4b9d-861e-09be2625ad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a741ea44-a5e2-4b9d-861e-09be2625ad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fba2363-16a2-4476-a40f-3b5041efcd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Volume 2927f8cc-7de9-47f1-9a0c-26749555e444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2927f8cc-7de9-47f1-9a0c-26749555e444', 'volume_size': 1} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-616769932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2927f8cc-7de9-47f1-9a0c-26749555e444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28690e53f93743cd9e42b64970cb4835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:53Z,use_quota=True,user_id='15309c17df6c44d7a8cea686aed0b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Creating volume 2927f8cc-7de9-47f1-9a0c-26749555e444 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:53 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:53 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 1073741824 Jul 21 17:32:53 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:53 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-4c7b9c15-848b-4594-b406-fc3bff64de71" returned: 0 in 0.317s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-4c7b9c15-848b-4594-b406-fc3bff64de71" released by "delete_volume" :: held 0.815s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created reservations ['a23687aa-c451-4924-a33e-b495ca466344', '9177bb81-46ca-49f5-bb2a-e066b3765c06', 'd62a43a5-4fcc-4bb4-9782-e9eb01933979', '57a5ca33-d5bb-444d-9b50-7ea45953ba2d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Flow 'volume_create_manager' (8f75654b-ba0a-4f48-866c-1a3307efdda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1da8ca7-1f85-428d-b333-8253d2a0bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1da8ca7-1f85-428d-b333-8253d2a0bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a82e13b-d1ec-4f5b-a86f-0921658e5d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc799ed69b4f66a7ee7469e65891a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:53Z,use_quota=True,user_id='46ebe357672a4fbdbe6bb6f521ca12ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78e2aa6-bae0-48f7-8615-949f73f789e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78e2aa6-bae0-48f7-8615-949f73f789e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776a9ae7-fe26-445d-8d9d-9080fe115e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.image.glance [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Creating Keystone auth plugin from conf {{(pid=87591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-b13c757e-3071-43b4-bdb5-f79cab2e688f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:53 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:53 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-b13c757e-3071-43b4-bdb5-f79cab2e688f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:53 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 1073741824" returned: 0 in 0.602s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-quobyte-b13c757e-3071-43b4-bdb5-f79cab2e688f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-b13c757e-3071-43b4-bdb5-f79cab2e688f" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:53 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 Jul 21 17:32:53 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d7687-206e-4a30-b53d-a60643c60a9a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:53 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.327s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:53 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f Jul 21 17:32:53 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:53 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Deleted volume successfully. Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-c4fe3b17-6d82-4257-896b-1ba14d419c1f tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-4c7b9c15-848b-4594-b406-fc3bff64de71-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776a9ae7-fe26-445d-8d9d-9080fe115e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a82e13b-d1ec-4f5b-a86f-0921658e5d42', 'volume_name': 'volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42', 'volume_size': 1, 'image_id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db8d276fee67c76cb733bfed739ba901', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8fc799ed69b4f66a7ee7469e65891a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64e79001aad77fe080949f345725647d944390c199424796acfd2c4fdf456245bb8254984b12bf4424956677897ee708d2e5b44e68cbf8101249f4a16a797197', 'id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'created_at': datetime.datetime(2026, 7, 21, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 32, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e/file', 'properties': {}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138a7814-dcb8-4a67-b582-45eee39a5cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138a7814-dcb8-4a67-b582-45eee39a5cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37914c6f-0aae-48c7-ae7b-355dcce02699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:53 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Volume 5a82e13b-d1ec-4f5b-a86f-0921658e5d42: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42', 'volume_size': 1, 'image_id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db8d276fee67c76cb733bfed739ba901', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8fc799ed69b4f66a7ee7469e65891a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64e79001aad77fe080949f345725647d944390c199424796acfd2c4fdf456245bb8254984b12bf4424956677897ee708d2e5b44e68cbf8101249f4a16a797197', 'id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'created_at': datetime.datetime(2026, 7, 21, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 32, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e/file', 'properties': {}}, 'image_service': } Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Trying to clone 5a82e13b-d1ec-4f5b-a86f-0921658e5d42 from image 0c48f805-a41f-4876-9bb5-bb6a96e0b84e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'metadata': {}}]). {{(pid=87591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 17:32:53 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.452s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Creating offline snapshot 76113f70-a7a0-42ce-97b6-d167d980f6d3 of volume 06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fba2363-16a2-4476-a40f-3b5041efcd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2927f8cc-7de9-47f1-9a0c-26749555e444', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a267bd-ca68-4765-83a7-bed3c2abc377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b173f7d-3368-4b87-88e9-6d62a83d0d88]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Volume volume-2927f8cc-7de9-47f1-9a0c-26749555e444 (2927f8cc-7de9-47f1-9a0c-26749555e444): created successfully Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a267bd-ca68-4765-83a7-bed3c2abc377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Flow 'volume_create_manager' (0da30f44-4cdd-4fbc-ac74-db0aa15f5f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:32:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0b7e5480-3a44-4bb7-b277-8ff010a7c874 tempest-ProjectReaderTests-215108973 None] Created volume successfully. Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 17:32:54 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Image download 0.00 MB at 0.00 MB/s Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[da561b0a-6bb9-4a90-80fc-6ec11a7cad19]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 Jul 21 17:32:54 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:54 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f Jul 21 17:32:54 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:54 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD Jul 21 17:32:54 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:54 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-b13c757e-3071-43b4-bdb5-f79cab2e688f" returned: 0 in 0.259s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:54 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963" returned: 0 in 0.446s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-b13c757e-3071-43b4-bdb5-f79cab2e688f" released by "delete_volume" :: held 0.787s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:54 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 1G Jul 21 17:32:54 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created reservations ['709e4e53-3e1b-4a68-96f0-6bd0d1d5763b', 'ce28ec21-3bc8-4c6e-9a15-c693de1c2f45', '56854216-c03b-4165-8f3c-44cadce3d601', '33e55a4f-b7b1-4ce3-9f28-dd54de2ead5c'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:54 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD Jul 21 17:32:54 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:54 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-0fa7ff7f-2e46-4933-aa3b-80855c492d7a-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-0fa7ff7f-2e46-4933-aa3b-80855c492d7a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-quobyte-0fa7ff7f-2e46-4933-aa3b-80855c492d7a" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-0fa7ff7f-2e46-4933-aa3b-80855c492d7a" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996ea68-a62a-4d0e-9b80-348b4300a76e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:54 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Temporary image 0c48f805-a41f-4876-9bb5-bb6a96e0b84e is fetched for user 46ebe357672a4fbdbe6bb6f521ca12ab. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 17:32:54 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.334s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:54 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Deleted volume successfully. Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c649244f-cd96-4a57-9ac3-5d2d055c7d0a]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-4e805b36-a0df-4063-ac24-17ed86237afa tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-b13c757e-3071-43b4-bdb5-f79cab2e688f-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:55 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 1G" returned: 0 in 0.566s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c0606c-be2c-4733-9369-ce9899c49963 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c0606c-be2c-4733-9369-ce9899c49963 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 Jul 21 17:32:55 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a Jul 21 17:32:55 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Acquiring lock "cinder-2927f8cc-7de9-47f1-9a0c-26749555e444-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Lock "cinder-2927f8cc-7de9-47f1-9a0c-26749555e444-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:55 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD Jul 21 17:32:55 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Acquiring lock "cinder-quobyte-2927f8cc-7de9-47f1-9a0c-26749555e444" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Lock "cinder-quobyte-2927f8cc-7de9-47f1-9a0c-26749555e444" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e1114-081c-413c-92db-d4d8b4edd3d4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 Jul 21 17:32:55 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a" returned: 0 in 0.528s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a Jul 21 17:32:55 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c0606c-be2c-4733-9369-ce9899c49963 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3" returned: 0 in 0.426s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 is being set with open permissions: ugo+rw Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 Jul 21 17:32:55 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD Jul 21 17:32:55 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444" returned: 0 in 0.445s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444 Jul 21 17:32:55 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0fa7ff7f-2e46-4933-aa3b-80855c492d7a" returned: 0 in 0.289s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-0fa7ff7f-2e46-4933-aa3b-80855c492d7a" released by "delete_volume" :: held 0.868s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:55 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3" returned: 0 in 0.310s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created reservations ['a090aaaa-ff33-4076-b165-abbd6d8d1f25', '12a556a7-3593-42d1-bc14-3a1d5a46bc1e', '9d633ab6-26e1-4b5a-a573-3ce17cf0e267', '4a75084e-4398-4c54-869b-79f2d570c7ea'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info Jul 21 17:32:55 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:55 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:55 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:55 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2927f8cc-7de9-47f1-9a0c-26749555e444" returned: 0 in 0.306s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-9f415827-f3ee-454d-9698-71aadcd026f8-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Lock "cinder-quobyte-2927f8cc-7de9-47f1-9a0c-26749555e444" released by "delete_volume" :: held 0.813s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-9f415827-f3ee-454d-9698-71aadcd026f8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "cinder-quobyte-9f415827-f3ee-454d-9698-71aadcd026f8" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-9f415827-f3ee-454d-9698-71aadcd026f8" acquired by "delete_volume" :: waited 0.028s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Created reservations ['c354b950-2a9a-40f9-bc25-fa0e9e12389c', 'cfc4935b-b0b0-49c6-99fd-b33791c5237d', '3098fc92-2569-4eea-913d-200a3d4e0e41', 'b013be79-8df6-48c9-92eb-8058eb16ea1e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241168d-be64-4d73-8909-91e24a95f18b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:56 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:56 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info is being set with open permissions: ugo+rw Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:56 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.269s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Deleted volume successfully. Jul 21 17:32:56 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info Jul 21 17:32:56 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-38748598-b792-47ee-ade4-3bc8fe4af160 tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-0fa7ff7f-2e46-4933-aa3b-80855c492d7a-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:56 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 Jul 21 17:32:56 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:56 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:56 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:56 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.info" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a82e13b-d1ec-4f5b-a86f-0921658e5d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc799ed69b4f66a7ee7469e65891a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:32:53Z,use_quota=True,user_id='46ebe357672a4fbdbe6bb6f521ca12ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Creating volume 5a82e13b-d1ec-4f5b-a86f-0921658e5d42 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:32:56 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:56 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.336s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Deleted volume successfully. Jul 21 17:32:56 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 1073741824 Jul 21 17:32:56 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b6a4131e-7363-4bd6-96a7-5514fd69c857 tempest-ProjectReaderTests-462039180 None] Create snapshot completed successfully Jul 21 17:32:56 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8" returned: 0 in 0.559s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a679f02a-0a8c-4cb6-9243-84eef5b48aea tempest-ProjectReaderTests-215108973 None] Lock "cinder-2927f8cc-7de9-47f1-9a0c-26749555e444-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:56 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8 Jul 21 17:32:56 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:56 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-9f415827-f3ee-454d-9698-71aadcd026f8" returned: 0 in 0.278s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-quobyte-9f415827-f3ee-454d-9698-71aadcd026f8" released by "delete_volume" :: held 0.880s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Created reservations ['ac7ab9d3-a96d-49c3-8599-0274342d7ad0', '754c04b2-6ab1-433d-bc0f-83044c27ab17', 'd672d1bc-e8ae-48c3-a4ec-7121b7488111', 'ce1d9f4c-4f8c-4feb-b33c-e57deef0a20a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:57 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:32:57 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:57 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 1073741824" returned: 0 in 0.560s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:57 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 Jul 21 17:32:57 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:57 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.279s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:32:57 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Deleted volume successfully. Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d58720b0-09c3-42af-a063-143e8643568e tempest-CreateVolumesFromSourceVolumeTest-1966540969 None] Lock "cinder-9f415827-f3ee-454d-9698-71aadcd026f8-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:32:57 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" returned: 0 in 0.348s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Attempting download of 0c48f805-a41f-4876-9bb5-bb6a96e0b84e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'metadata': {}}])) to volume 5a82e13b-d1ec-4f5b-a86f-0921658e5d42. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[570223c3-e549-48cd-a78d-c739a5064e82]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:57 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6 Jul 21 17:32:57 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-76113f70-a7a0-42ce-97b6-d167d980f6d3-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Lock "cinder-76113f70-a7a0-42ce-97b6-d167d980f6d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-06c0606c-be2c-4733-9369-ce9899c49963" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-06c0606c-be2c-4733-9369-ce9899c49963" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-76113f70-a7a0-42ce-97b6-d167d980f6d3" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-76113f70-a7a0-42ce-97b6-d167d980f6d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:32:58 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Deleting offline snapshot 76113f70-a7a0-42ce-97b6-d167d980f6d3 of volume 06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] snapshot_file for this snap is: volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6" returned: 0 in 0.501s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce786b2-0695-4c3e-9e87-0ad827ee6ffc]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:58 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 Jul 21 17:32:58 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:58 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6 Jul 21 17:32:58 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:58 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6" returned: 1 in 0.435s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_a9cetgv6' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba31258-781a-40fc-9f1e-a0b49f3b3b91]: (4, 'raw') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:58 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3" returned: 0 in 0.459s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c0606c-be2c-4733-9369-ce9899c49963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e2bc6-3bd2-4722-b6c7-2af7622a47ea]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:58 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD Jul 21 17:32:58 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:58 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 Jul 21 17:32:58 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:58 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:59 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD Jul 21 17:32:59 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:59 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963" returned: 0 in 0.461s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:59 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 Jul 21 17:32:59 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:59 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] 0c48f805-a41f-4876-9bb5-bb6a96e0b84e was raw, converting to qcow2 {{(pid=87591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:59 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 Jul 21 17:32:59 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:59 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3" returned: 0 in 0.478s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:32:59 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3 Jul 21 17:32:59 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:32:59 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 21 17:32:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963.76113f70-a7a0-42ce-97b6-d167d980f6d3" returned: 0 in 0.379s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-76113f70-a7a0-42ce-97b6-d167d980f6d3" released by "_delete_snapshot" :: held 1.916s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-06c0606c-be2c-4733-9369-ce9899c49963" released by "delete_snapshot" :: held 1.948s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:00 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" returned: 0 in 0.719s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c48f805-a41f-4876-9bb5-bb6a96e0b84e_w4myejnndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:33:00 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:00 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 1G Jul 21 17:33:00 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Created reservations ['abdc9d22-1edd-4f83-a4c1-2ba4db1fd65a', '774dc03a-a658-4965-958d-72425c41ccea', '359125d2-4758-4ec8-bbf1-9f8a21a01160', '7f90e775-bb7e-4d93-9d4a-00fcbe4966d8'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Delete snapshot completed successfully. Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-562d035f-9274-4636-b91c-684ecde48457 tempest-ProjectReaderTests-462039180 None] Lock "cinder-76113f70-a7a0-42ce-97b6-d167d980f6d3-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:00 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 1G" returned: 0 in 0.416s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Downloaded image 0c48f805-a41f-4876-9bb5-bb6a96e0b84e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'metadata': {}}])) to volume 5a82e13b-d1ec-4f5b-a86f-0921658e5d42 successfully. {{(pid=87591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Temporary image 0c48f805-a41f-4876-9bb5-bb6a96e0b84e for user 46ebe357672a4fbdbe6bb6f521ca12ab is deleted. {{(pid=87591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.volume_utils [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Marking volume 5a82e13b-d1ec-4f5b-a86f-0921658e5d42 as bootable. {{(pid=87591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Copying metadata from image 0c48f805-a41f-4876-9bb5-bb6a96e0b84e to 5a82e13b-d1ec-4f5b-a86f-0921658e5d42. {{(pid=87591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Creating volume glance metadata for volume 5a82e13b-d1ec-4f5b-a86f-0921658e5d42 backed by image 0c48f805-a41f-4876-9bb5-bb6a96e0b84e with: {'image_id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'db8d276fee67c76cb733bfed739ba901', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37914c6f-0aae-48c7-ae7b-355dcce02699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42', 'volume_size': 1, 'image_id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db8d276fee67c76cb733bfed739ba901', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8fc799ed69b4f66a7ee7469e65891a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64e79001aad77fe080949f345725647d944390c199424796acfd2c4fdf456245bb8254984b12bf4424956677897ee708d2e5b44e68cbf8101249f4a16a797197', 'id': '0c48f805-a41f-4876-9bb5-bb6a96e0b84e', 'created_at': datetime.datetime(2026, 7, 21, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 15, 32, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c48f805-a41f-4876-9bb5-bb6a96e0b84e/file', 'properties': {}}, 'image_service': }' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66ad2e8-1998-4e04-93f4-60a345e0a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:00 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Volume volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 (5a82e13b-d1ec-4f5b-a86f-0921658e5d42): created successfully Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66ad2e8-1998-4e04-93f4-60a345e0a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Flow 'volume_create_manager' (8f75654b-ba0a-4f48-866c-1a3307efdda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-df0b807e-672d-483f-a3d4-8505648edc51 tempest-VolumeImageDependencyTests-493653234 None] Created volume successfully. Jul 21 17:33:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Acquiring lock "cinder-5a82e13b-d1ec-4f5b-a86f-0921658e5d42-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Lock "cinder-5a82e13b-d1ec-4f5b-a86f-0921658e5d42-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Acquiring lock "cinder-quobyte-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Lock "cinder-quobyte-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e364cae-7488-41c8-8c54-b46a735ff5ea]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:01 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 Jul 21 17:33:01 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-06c0606c-be2c-4733-9369-ce9899c49963-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Lock "cinder-06c0606c-be2c-4733-9369-ce9899c49963-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-06c0606c-be2c-4733-9369-ce9899c49963" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-06c0606c-be2c-4733-9369-ce9899c49963" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e186d3d-9711-4f7b-8606-7e20f0be59e1]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:01 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 Jul 21 17:33:01 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:01 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" returned: 0 in 0.585s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:01 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42 Jul 21 17:33:01 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (7b2c3d49-b755-4a61-8480-219f092a2250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b430acf-dd44-4328-8eac-13b54772b21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b430acf-dd44-4328-8eac-13b54772b21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305007186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cc3f6d-e961-4867-8e33-ceaed365c176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:02Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3d4b87-1d19-44a7-850c-6330429c6dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3d4b87-1d19-44a7-850c-6330429c6dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f9abe3-f451-4b0c-bd81-138d1082f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f9abe3-f451-4b0c-bd81-138d1082f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cc3f6d-e961-4867-8e33-ceaed365c176', 'volume_name': 'volume-10cc3f6d-e961-4867-8e33-ceaed365c176', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:01 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aadab9b-1a25-4e4c-9c4f-e1d2e87dc559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aadab9b-1a25-4e4c-9c4f-e1d2e87dc559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11670c90-81d5-404e-a9d2-ed70102dba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:01 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Volume 10cc3f6d-e961-4867-8e33-ceaed365c176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cc3f6d-e961-4867-8e33-ceaed365c176', 'volume_size': 1} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305007186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cc3f6d-e961-4867-8e33-ceaed365c176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:02Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Creating volume 10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:01 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963" returned: 0 in 0.526s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:01 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 1073741824 Jul 21 17:33:01 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:02 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" returned: 0 in 0.295s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:02 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963 Jul 21 17:33:02 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Lock "cinder-quobyte-5a82e13b-d1ec-4f5b-a86f-0921658e5d42" released by "delete_volume" :: held 0.946s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Created reservations ['7474bdcf-2952-4557-abcd-b268a3cc9c10', '76923b40-8635-4497-b568-abc31bd0e20f', '1c4f0a95-0801-43cd-bc9f-37473da6317f', '7fed3e71-9e6c-40ad-a4cf-afe463e97cd2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:02 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:02 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:02 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-06c0606c-be2c-4733-9369-ce9899c49963" returned: 0 in 0.370s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-06c0606c-be2c-4733-9369-ce9899c49963" released by "delete_volume" :: held 0.974s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Created reservations ['f09bb338-41a8-4d89-9e7f-dc2700c388b3', '5fc9e2bd-3a51-466e-9055-9799836e6054', '949d561a-2c01-4a99-a72b-13d9757ad88b', '98863fab-5446-4d57-8b25-6051c45ed7b4'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:02 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Deleted volume successfully. Jul 21 17:33:02 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-44277e09-ba2a-45c1-9408-6eac248e9d6e tempest-VolumeImageDependencyTests-493653234 None] Lock "cinder-5a82e13b-d1ec-4f5b-a86f-0921658e5d42-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 1073741824" returned: 0 in 0.619s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:02 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:02 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:02 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 Jul 21 17:33:02 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:02 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.288s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Deleted volume successfully. Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-075d4511-f793-4032-b31f-9c1e00c1c290 tempest-ProjectReaderTests-462039180 None] Lock "cinder-06c0606c-be2c-4733-9369-ce9899c49963-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:02 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176" returned: 0 in 0.297s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11670c90-81d5-404e-a9d2-ed70102dba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cc3f6d-e961-4867-8e33-ceaed365c176', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9e0abb-35da-4152-b165-c2c2955335a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:02 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Volume volume-10cc3f6d-e961-4867-8e33-ceaed365c176 (10cc3f6d-e961-4867-8e33-ceaed365c176): created successfully Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9e0abb-35da-4152-b165-c2c2955335a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (7b2c3d49-b755-4a61-8480-219f092a2250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-22220e46-e25a-4450-af61-2d4867f252ba tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (469a599a-1604-4e23-8404-26164efcef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062547d9-20a5-45b0-8aac-a9cda695fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062547d9-20a5-45b0-8aac-a9cda695fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361582149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4d9be6-6943-453f-af55-768844cd21a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:04Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513123c8-0cdc-4e83-ab8b-4ce94479e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513123c8-0cdc-4e83-ab8b-4ce94479e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa8810c-1c87-49a5-a32e-a110023e8425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa8810c-1c87-49a5-a32e-a110023e8425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4d9be6-6943-453f-af55-768844cd21a9', 'volume_name': 'volume-ec4d9be6-6943-453f-af55-768844cd21a9', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f3f9ea-f784-4c51-b417-34be2809a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f3f9ea-f784-4c51-b417-34be2809a03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5be1e6-9644-489b-ad50-fed6ded7005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:04 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Volume ec4d9be6-6943-453f-af55-768844cd21a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4d9be6-6943-453f-af55-768844cd21a9', 'volume_size': 1} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361582149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4d9be6-6943-453f-af55-768844cd21a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:04Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Creating volume ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:04 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:04 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 1073741824 Jul 21 17:33:04 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:04 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 1073741824" returned: 0 in 0.523s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:04 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:04 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 Jul 21 17:33:04 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:05 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9" returned: 0 in 0.303s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.811s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5be1e6-9644-489b-ad50-fed6ded7005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4d9be6-6943-453f-af55-768844cd21a9', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7c09f4-305a-41b2-b49f-7185c5b4d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:05 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Volume volume-ec4d9be6-6943-453f-af55-768844cd21a9 (ec4d9be6-6943-453f-af55-768844cd21a9): created successfully Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7c09f4-305a-41b2-b49f-7185c5b4d199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (469a599a-1604-4e23-8404-26164efcef15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot db2412eb-5bf5-416d-8e72-5fb98a3293ea of volume 10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:05 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d624ca99-77b2-4c17-bfd9-f55422d2118c tempest-ProjectReaderTests-462039180 None] Created volume successfully. Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343eea6-56ae-4298-b230-41aacdc36fd9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:05 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 Jul 21 17:33:05 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:05 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176" returned: 0 in 0.471s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:05 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea 1G Jul 21 17:33:05 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:06 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea 1G" returned: 0 in 0.595s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10cc3f6d-e961-4867-8e33-ceaed365c176 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:06 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10cc3f6d-e961-4867-8e33-ceaed365c176 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea Jul 21 17:33:06 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:06 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10cc3f6d-e961-4867-8e33-ceaed365c176 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea" returned: 0 in 0.439s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:06 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea is being set with open permissions: ugo+rw Jul 21 17:33:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:06 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea Jul 21 17:33:06 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:07 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea" returned: 0 in 0.360s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:07 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:07 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Flow 'volume_create_manager' (dbf083e2-a7f4-46d8-a11d-db10efbfa964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866c2baf-75e2-4766-a3f9-69dcd975bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866c2baf-75e2-4766-a3f9-69dcd975bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038f4bca-7533-4f91-85b1-62ef3cd2cb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6361af4fb743c3887a9cfd2328f370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:07Z,use_quota=True,user_id='fce00477545540ed93851d931830c513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3666eec9-1bdc-4d11-98bc-08dfb5b7b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3666eec9-1bdc-4d11-98bc-08dfb5b7b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db415ecb-5d9d-4bb8-8fea-894512221ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db415ecb-5d9d-4bb8-8fea-894512221ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038f4bca-7533-4f91-85b1-62ef3cd2cb96', 'volume_name': 'volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d71d0e-b902-4e6c-abc0-8b3e29982f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d71d0e-b902-4e6c-abc0-8b3e29982f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162a4c4f-f0c5-46a1-b219-0afdae9a0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:07 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Volume 038f4bca-7533-4f91-85b1-62ef3cd2cb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96', 'volume_size': 1} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:07 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info" returned: 0 in 0.395s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:07 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info is being set with open permissions: ugo+rw Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:07 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info Jul 21 17:33:07 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:07 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.info" returned: 0 in 0.271s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.733s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.341s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:07 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Creating offline snapshot d608e17f-35e6-4893-9cf6-64ed89d54358 of volume ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-fdb321d3-189c-418d-8a99-e0a7db1af8b7 tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7e8a9-ef4c-4749-adb6-2a2726b1ac36]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:08 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 Jul 21 17:33:08 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:08 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9" returned: 0 in 0.412s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:08 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 1G Jul 21 17:33:08 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-db2412eb-5bf5-416d-8e72-5fb98a3293ea-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Lock "cinder-db2412eb-5bf5-416d-8e72-5fb98a3293ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-10cc3f6d-e961-4867-8e33-ceaed365c176" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-10cc3f6d-e961-4867-8e33-ceaed365c176" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-db2412eb-5bf5-416d-8e72-5fb98a3293ea" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-db2412eb-5bf5-416d-8e72-5fb98a3293ea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot db2412eb-5bf5-416d-8e72-5fb98a3293ea of volume 10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[94edc5d1-4d0b-48ed-b746-f93d49a4e416]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:08 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea Jul 21 17:33:08 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:08 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 1G" returned: 0 in 0.514s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4d9be6-6943-453f-af55-768844cd21a9 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:08 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4d9be6-6943-453f-af55-768844cd21a9 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 Jul 21 17:33:08 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:09 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea" returned: 0 in 0.422s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10cc3f6d-e961-4867-8e33-ceaed365c176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad1190-f1c9-4fee-9ce5-73a2cb4a9a07]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:09 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4d9be6-6943-453f-af55-768844cd21a9 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358" returned: 0 in 0.351s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:09 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 is being set with open permissions: ugo+rw Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:09 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 Jul 21 17:33:09 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:09 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 Jul 21 17:33:09 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:09 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358" returned: 0 in 0.254s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:09 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info Jul 21 17:33:09 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:09 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176" returned: 0 in 0.420s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:09 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea Jul 21 17:33:09 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:09 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info" returned: 0 in 0.326s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:09 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info is being set with open permissions: ugo+rw Jul 21 17:33:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:09 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info Jul 21 17:33:09 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:10 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea" returned: 0 in 0.457s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:10 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea Jul 21 17:33:10 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:10 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.info" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.859s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038f4bca-7533-4f91-85b1-62ef3cd2cb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6361af4fb743c3887a9cfd2328f370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:07Z,use_quota=True,user_id='fce00477545540ed93851d931830c513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Creating volume 038f4bca-7533-4f91-85b1-62ef3cd2cb96 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:10 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:10 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 1073741824 Jul 21 17:33:10 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6a00a513-0493-4554-96ca-a69b32205bb2 tempest-ProjectReaderTests-462039180 None] Create snapshot completed successfully Jul 21 17:33:10 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176.db2412eb-5bf5-416d-8e72-5fb98a3293ea" returned: 0 in 0.356s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-db2412eb-5bf5-416d-8e72-5fb98a3293ea" released by "_delete_snapshot" :: held 1.796s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-10cc3f6d-e961-4867-8e33-ceaed365c176" released by "delete_snapshot" :: held 1.824s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Created reservations ['baa824c6-312f-4b04-a32d-2d9c63eb76d2', '36751f28-8c39-4716-8057-d8dab241a380', 'a046d9c6-da43-4137-a46e-a0e8454c743e', 'c9cdedb8-4a48-4dce-8253-f672a29f3f55'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:10 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e12d17f4-3aa9-409c-a52c-3a954ee6659b tempest-ProjectMemberTests-1964957264 None] Lock "cinder-db2412eb-5bf5-416d-8e72-5fb98a3293ea-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-d608e17f-35e6-4893-9cf6-64ed89d54358-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Lock "cinder-d608e17f-35e6-4893-9cf6-64ed89d54358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-ec4d9be6-6943-453f-af55-768844cd21a9" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:10 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-10cc3f6d-e961-4867-8e33-ceaed365c176-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-ec4d9be6-6943-453f-af55-768844cd21a9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-d608e17f-35e6-4893-9cf6-64ed89d54358" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 1073741824" returned: 0 in 0.635s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-d608e17f-35e6-4893-9cf6-64ed89d54358" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Deleting offline snapshot d608e17f-35e6-4893-9cf6-64ed89d54358 of volume ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] snapshot_file for this snap is: volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-10cc3f6d-e961-4867-8e33-ceaed365c176-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16ab02d-33c6-40b1-b99c-88239dc2cba4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:11 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 Jul 21 17:33:11 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-10cc3f6d-e961-4867-8e33-ceaed365c176" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-10cc3f6d-e961-4867-8e33-ceaed365c176" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:11 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 Jul 21 17:33:11 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b053f2-e684-45f4-857b-7d4a91d7e8c0]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:11 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 Jul 21 17:33:11 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:11 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96" returned: 0 in 0.287s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162a4c4f-f0c5-46a1-b219-0afdae9a0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a304a3-823c-4595-b305-aa7c72ae127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:11 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Volume volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 (038f4bca-7533-4f91-85b1-62ef3cd2cb96): created successfully Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a304a3-823c-4595-b305-aa7c72ae127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Flow 'volume_create_manager' (dbf083e2-a7f4-46d8-a11d-db10efbfa964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:11 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-be5fdd98-962c-49b6-abbb-7cab45002722 tempest-CinderUnicodeTest-739172846 None] Created volume successfully. Jul 21 17:33:11 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358" returned: 0 in 0.458s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4d9be6-6943-453f-af55-768844cd21a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f3e2cf-6c59-41be-a860-204b61125597]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:11 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176" returned: 0 in 0.462s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:11 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176 Jul 21 17:33:11 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:11 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 Jul 21 17:33:11 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:11 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-10cc3f6d-e961-4867-8e33-ceaed365c176" returned: 0 in 0.299s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-10cc3f6d-e961-4867-8e33-ceaed365c176" released by "delete_volume" :: held 0.845s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=214,cinder:UPDATE=312,cinder:INSERT=83,cinder:DELETE=30 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:33:11 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=298,cinder:SELECT=236,cinder:DELETE=26,cinder:INSERT=79 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:33:12 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9" returned: 0 in 0.516s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:12 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 Jul 21 17:33:12 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Created reservations ['fb5c21ab-e563-4c2e-ae67-ca8b09c76d70', 'f4130b6a-0b9b-4ef7-833a-9699b2d2c206', 'aff5a65a-866d-46b5-a7ac-459009b83ecd', '169b58ea-6c99-4bda-a7ba-8154bfa7e0aa'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:12 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:12 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Flow 'volume_create_manager' (fe938bc3-5611-484a-955d-710a15468f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf72ac2-b40a-4a71-9c4b-0d4d5593e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf72ac2-b40a-4a71-9c4b-0d4d5593e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-946281572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d07841-216b-4bf4-b80b-e90aa65c356d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6361af4fb743c3887a9cfd2328f370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:12Z,use_quota=True,user_id='fce00477545540ed93851d931830c513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ec79c-b219-4595-9fea-90544bad7c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ec79c-b219-4595-9fea-90544bad7c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48a3e22-3ba3-421b-a0b8-b077a103165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48a3e22-3ba3-421b-a0b8-b077a103165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d07841-216b-4bf4-b80b-e90aa65c356d', 'volume_name': 'volume-41d07841-216b-4bf4-b80b-e90aa65c356d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d8dc21-3ff2-4a81-8a3e-22c4e82d7c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d8dc21-3ff2-4a81-8a3e-22c4e82d7c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f085953-01ac-49ae-b0cf-dfef45eb6f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:12 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Volume 41d07841-216b-4bf4-b80b-e90aa65c356d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d07841-216b-4bf4-b80b-e90aa65c356d', 'volume_size': 1} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-946281572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d07841-216b-4bf4-b80b-e90aa65c356d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6361af4fb743c3887a9cfd2328f370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:12Z,use_quota=True,user_id='fce00477545540ed93851d931830c513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Creating volume 41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:12 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:12 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d 1073741824 Jul 21 17:33:12 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:12 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358" returned: 0 in 0.450s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:12 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358 Jul 21 17:33:12 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:12 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.359s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-8aa308a3-78a8-4b85-81f5-c6c83e579642 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-10cc3f6d-e961-4867-8e33-ceaed365c176-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:12 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9.d608e17f-35e6-4893-9cf6-64ed89d54358" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-d608e17f-35e6-4893-9cf6-64ed89d54358" released by "_delete_snapshot" :: held 1.923s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-ec4d9be6-6943-453f-af55-768844cd21a9" released by "delete_snapshot" :: held 1.964s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Created reservations ['03a1856d-2c28-4d30-a8dc-8a48d07cb5e2', '61b5ea6c-709d-4c2b-ab50-37f45217cdbe', '427f69f3-f7cd-4e00-90f5-503693c90235', 'a2ca5e8b-91e8-4b06-bd92-694cddf6d810'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:12 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d 1073741824" returned: 0 in 0.576s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Delete snapshot completed successfully. Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-cdd46f2b-98f1-47c1-96d0-c232e1ec2127 tempest-ProjectReaderTests-462039180 None] Lock "cinder-d608e17f-35e6-4893-9cf6-64ed89d54358-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:13 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d Jul 21 17:33:13 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:13 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d" returned: 0 in 0.269s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f085953-01ac-49ae-b0cf-dfef45eb6f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d07841-216b-4bf4-b80b-e90aa65c356d', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8160b9-70a4-4e8f-8d86-1bb21a632bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Volume volume-41d07841-216b-4bf4-b80b-e90aa65c356d (41d07841-216b-4bf4-b80b-e90aa65c356d): created successfully Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8160b9-70a4-4e8f-8d86-1bb21a632bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Flow 'volume_create_manager' (fe938bc3-5611-484a-955d-710a15468f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:13 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-56020c25-71a2-439d-91ea-5d5630ae16c3 tempest-CinderUnicodeTest-739172846 None] Created volume successfully. Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (8efe1bee-a50d-433e-8213-62816b222698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343b8a18-fda9-4349-9454-a5b1d301301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343b8a18-fda9-4349-9454-a5b1d301301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273620825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d00133c-8c1a-4e05-9612-0c32eb123186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:14Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f4fc8f-3f71-4bc3-b71b-3717f9a755d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f4fc8f-3f71-4bc3-b71b-3717f9a755d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a7883f-51c6-4019-8317-12289a9a9d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a7883f-51c6-4019-8317-12289a9a9d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d00133c-8c1a-4e05-9612-0c32eb123186', 'volume_name': 'volume-7d00133c-8c1a-4e05-9612-0c32eb123186', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf19ace-3540-4c70-a42c-44b5f429792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf19ace-3540-4c70-a42c-44b5f429792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01706ce3-bb14-4835-9413-2a8e76c02a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Volume 7d00133c-8c1a-4e05-9612-0c32eb123186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d00133c-8c1a-4e05-9612-0c32eb123186', 'volume_size': 1} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273620825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d00133c-8c1a-4e05-9612-0c32eb123186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:14Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Creating volume 7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:13 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:13 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 1073741824 Jul 21 17:33:13 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-ec4d9be6-6943-453f-af55-768844cd21a9-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Lock "cinder-ec4d9be6-6943-453f-af55-768844cd21a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-ec4d9be6-6943-453f-af55-768844cd21a9" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-ec4d9be6-6943-453f-af55-768844cd21a9" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc3587c-485b-4428-ba7d-427336c34ef4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:14 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 Jul 21 17:33:14 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:14 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 1073741824" returned: 0 in 0.523s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:14 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 Jul 21 17:33:14 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:14 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9" returned: 0 in 0.531s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:14 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9 Jul 21 17:33:14 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:14 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186" returned: 0 in 0.339s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.038s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01706ce3-bb14-4835-9413-2a8e76c02a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d00133c-8c1a-4e05-9612-0c32eb123186', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5905d24a-4674-4b1a-9464-370d36e6c826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Creating offline snapshot e6865d6e-78be-4d68-bef1-a69838305056 of volume 41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Volume volume-7d00133c-8c1a-4e05-9612-0c32eb123186 (7d00133c-8c1a-4e05-9612-0c32eb123186): created successfully Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5905d24a-4674-4b1a-9464-370d36e6c826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (8efe1bee-a50d-433e-8213-62816b222698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cbdce9-e944-4e17-9c36-c108aedbc21e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0d3f71e9-6b18-4431-b76f-11f2289445cd tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:33:14 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d Jul 21 17:33:14 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:15 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ec4d9be6-6943-453f-af55-768844cd21a9" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-ec4d9be6-6943-453f-af55-768844cd21a9" released by "delete_volume" :: held 0.912s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Created reservations ['f41f2d30-6630-438b-be82-6ac2dfa4eb01', '86553f7d-35b2-45ba-b00f-73bced6b7ea4', 'e12fb046-760e-4a2f-950e-8e882608b00a', 'a035f92b-b23a-4d5c-a2f7-695654a7e53a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:15 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:15 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:15 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d" returned: 0 in 0.443s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:15 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 1G Jul 21 17:33:15 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:15 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.314s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Deleted volume successfully. Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-31204204-eb6d-4b57-82db-0ab01a1dd2c3 tempest-ProjectReaderTests-462039180 None] Lock "cinder-ec4d9be6-6943-453f-af55-768844cd21a9-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:15 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 1G" returned: 0 in 0.523s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d07841-216b-4bf4-b80b-e90aa65c356d -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:15 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d07841-216b-4bf4-b80b-e90aa65c356d -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 Jul 21 17:33:15 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (0eeaff23-588e-4128-b1c3-6fa46ef67eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268a14bc-9309-4034-801b-d46ad7370fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268a14bc-9309-4034-801b-d46ad7370fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849989046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421ce34a-61bd-4937-9bbd-eaa6c58c9901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:16Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ac6a66-e56b-485e-ab57-08558d790e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ac6a66-e56b-485e-ab57-08558d790e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:15 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8af37c2-c5df-41fa-a0ff-3267ea318166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8af37c2-c5df-41fa-a0ff-3267ea318166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421ce34a-61bd-4937-9bbd-eaa6c58c9901', 'volume_name': 'volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06026735-bbf3-4cc0-9002-a7f61b88692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06026735-bbf3-4cc0-9002-a7f61b88692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67e881f-467e-40dd-978f-b494b9272229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Volume 421ce34a-61bd-4937-9bbd-eaa6c58c9901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901', 'volume_size': 1} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:16 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d07841-216b-4bf4-b80b-e90aa65c356d -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056" returned: 0 in 0.382s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:16 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 is being set with open permissions: ugo+rw Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:16 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 Jul 21 17:33:16 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:16 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056" returned: 0 in 0.246s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:16 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info Jul 21 17:33:16 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:16 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info" returned: 0 in 0.240s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:16 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info is being set with open permissions: ugo+rw Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:16 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info Jul 21 17:33:16 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:16 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.info" returned: 0 in 0.247s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849989046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421ce34a-61bd-4937-9bbd-eaa6c58c9901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:16Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Creating volume 421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:17 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:17 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 1073741824 Jul 21 17:33:17 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c873067d-e20e-4cd2-8378-895faaf71178 tempest-CinderUnicodeTest-739172846 None] Create snapshot completed successfully Jul 21 17:33:17 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 1073741824" returned: 0 in 0.477s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:17 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 Jul 21 17:33:17 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:17 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901" returned: 0 in 0.250s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.746s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67e881f-467e-40dd-978f-b494b9272229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0608d944-277a-4d03-ad33-2548d47be7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot 2bc91980-ba19-46a1-a9a3-53b31d5090d9 of volume 7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Volume volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 (421ce34a-61bd-4937-9bbd-eaa6c58c9901): created successfully Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0608d944-277a-4d03-ad33-2548d47be7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (0eeaff23-588e-4128-b1c3-6fa46ef67eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe6302e-da75-4841-95b6-9c1356111bcc]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6f4349bd-25a7-459c-8e5c-81fd8d8bae1c tempest-ProjectReaderTests-462039180 None] Created volume successfully. Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-e6865d6e-78be-4d68-bef1-a69838305056-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Lock "cinder-e6865d6e-78be-4d68-bef1-a69838305056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-quobyte-41d07841-216b-4bf4-b80b-e90aa65c356d" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-41d07841-216b-4bf4-b80b-e90aa65c356d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-quobyte-e6865d6e-78be-4d68-bef1-a69838305056" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-e6865d6e-78be-4d68-bef1-a69838305056" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Deleting offline snapshot e6865d6e-78be-4d68-bef1-a69838305056 of volume 41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] snapshot_file for this snap is: volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454d406-cc53-4b4e-a9de-51ef5f9eaa52]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:18 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 Jul 21 17:33:18 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:18 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 Jul 21 17:33:18 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:18 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186" returned: 0 in 0.570s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:18 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 1G Jul 21 17:33:18 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:18 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056" returned: 0 in 0.512s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41d07841-216b-4bf4-b80b-e90aa65c356d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0d8796-1dbe-4c74-b729-096f2f3f72d3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:18 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d Jul 21 17:33:18 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:19 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 1G" returned: 0 in 0.532s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d00133c-8c1a-4e05-9612-0c32eb123186 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:19 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d00133c-8c1a-4e05-9612-0c32eb123186 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 Jul 21 17:33:19 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:19 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d" returned: 0 in 0.527s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:19 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 Jul 21 17:33:19 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:19 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d00133c-8c1a-4e05-9612-0c32eb123186 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9" returned: 0 in 0.477s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:19 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 is being set with open permissions: ugo+rw Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:19 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 Jul 21 17:33:19 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:19 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056" returned: 0 in 0.499s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:19 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056 Jul 21 17:33:19 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:19 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:19 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info Jul 21 17:33:19 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:19 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d.e6865d6e-78be-4d68-bef1-a69838305056" returned: 0 in 0.320s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-e6865d6e-78be-4d68-bef1-a69838305056" released by "_delete_snapshot" :: held 1.991s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-41d07841-216b-4bf4-b80b-e90aa65c356d" released by "delete_snapshot" :: held 2.026s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Created reservations ['6d9f1d6b-c834-4e21-8b7f-d409ca5597ee', '1540ceb8-4c85-46b9-bd21-37ffaec0f962', '5ea7ab0d-da19-428e-b797-15ad199dee0e', 'e86a6da8-f331-4a9e-afef-94547b9ef534'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:20 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info" returned: 0 in 0.311s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:20 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info is being set with open permissions: ugo+rw Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Delete snapshot completed successfully. Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-585d96de-14e5-4c02-8a85-c02c5a56ea9c tempest-CinderUnicodeTest-739172846 None] Lock "cinder-e6865d6e-78be-4d68-bef1-a69838305056-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:20 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info Jul 21 17:33:20 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:20 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.info" returned: 0 in 0.319s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.965s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Creating offline snapshot 9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 of volume 421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e4dbbb-c648-4b7f-aa0f-3cd26a5991a6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7b179f0a-f762-4acf-be2c-5508b4496a73 tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:33:20 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 Jul 21 17:33:20 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:20 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901" returned: 0 in 0.376s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 1G Jul 21 17:33:21 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-41d07841-216b-4bf4-b80b-e90aa65c356d-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-41d07841-216b-4bf4-b80b-e90aa65c356d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-quobyte-41d07841-216b-4bf4-b80b-e90aa65c356d" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-41d07841-216b-4bf4-b80b-e90aa65c356d" acquired by "delete_volume" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-2bc91980-ba19-46a1-a9a3-53b31d5090d9-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f2d23-6b4b-4d68-a11f-e3e7ca722f81]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-2bc91980-ba19-46a1-a9a3-53b31d5090d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-7d00133c-8c1a-4e05-9612-0c32eb123186" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-7d00133c-8c1a-4e05-9612-0c32eb123186" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-2bc91980-ba19-46a1-a9a3-53b31d5090d9" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-2bc91980-ba19-46a1-a9a3-53b31d5090d9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot 2bc91980-ba19-46a1-a9a3-53b31d5090d9 of volume 7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[25541ebe-0188-4669-9336-f3feaab31456]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d Jul 21 17:33:21 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:21 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 1G" returned: 0 in 0.574s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 Jul 21 17:33:21 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:21 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 Jul 21 17:33:21 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:21 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d" returned: 0 in 0.383s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d Jul 21 17:33:21 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:21 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d00133c-8c1a-4e05-9612-0c32eb123186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:21 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" returned: 0 in 0.379s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:21 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 is being set with open permissions: ugo+rw Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ed856-ac85-46b4-a94b-2b224797db09]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:21 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 Jul 21 17:33:21 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 Jul 21 17:33:22 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-41d07841-216b-4bf4-b80b-e90aa65c356d" returned: 0 in 0.305s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-41d07841-216b-4bf4-b80b-e90aa65c356d" released by "delete_volume" :: held 0.780s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Created reservations ['8ca7b842-0f57-4ce0-a2d8-b60fad93532e', '8f6cab2f-99eb-4a8a-a05d-6da0c8f447b8', '31a33a09-7dab-410a-98d0-305301c075aa', '87d76333-e2a8-4f54-86e5-3f80f558d73e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:22 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" returned: 0 in 0.277s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:22 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:22 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info Jul 21 17:33:22 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186" returned: 0 in 0.430s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:22 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 Jul 21 17:33:22 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-038f4bca-7533-4f91-85b1-62ef3cd2cb96-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-038f4bca-7533-4f91-85b1-62ef3cd2cb96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:22 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "cinder-quobyte-038f4bca-7533-4f91-85b1-62ef3cd2cb96" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:22 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Deleted volume successfully. Jul 21 17:33:22 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-038f4bca-7533-4f91-85b1-62ef3cd2cb96" acquired by "delete_volume" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-84cd85eb-9563-4844-befe-201eb4a71e41 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-41d07841-216b-4bf4-b80b-e90aa65c356d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info" returned: 0 in 0.428s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:22 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info is being set with open permissions: ugo+rw Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0532e-52ea-483e-ab38-604618361fc3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:22 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info Jul 21 17:33:22 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 Jul 21 17:33:22 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:22 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9" returned: 0 in 0.584s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:23 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9 Jul 21 17:33:23 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:23 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.info" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e705e880-219a-403c-97a8-01453714d221 tempest-ProjectReaderTests-462039180 None] Create snapshot completed successfully Jul 21 17:33:23 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186.2bc91980-ba19-46a1-a9a3-53b31d5090d9" returned: 0 in 0.308s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:23 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96" returned: 0 in 0.573s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:23 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96 Jul 21 17:33:23 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-2bc91980-ba19-46a1-a9a3-53b31d5090d9" released by "_delete_snapshot" :: held 1.889s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-7d00133c-8c1a-4e05-9612-0c32eb123186" released by "delete_snapshot" :: held 1.924s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Created reservations ['f6689844-44be-4668-b518-f24402ac5499', 'f38b99ff-20aa-4c49-8832-47192d77cb25', '1c3b49d6-0fc2-4000-a6c9-56d01d6fe5fb', 'dfbfe45a-9c1b-44bc-a4c4-c739f79fe005'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-9158abd8-1ef1-47c5-a608-7482348a3f6f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-2bc91980-ba19-46a1-a9a3-53b31d5090d9-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:23 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-038f4bca-7533-4f91-85b1-62ef3cd2cb96" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-quobyte-038f4bca-7533-4f91-85b1-62ef3cd2cb96" released by "delete_volume" :: held 0.912s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-7d00133c-8c1a-4e05-9612-0c32eb123186-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Created reservations ['145545db-5d81-4b32-b410-39ad3e712a57', '67e96882-b5f6-44b2-a777-1cce1c0c091a', '319ae89b-2f50-4b71-b60b-32e82ddda318', '87a0ee17-c5ca-4d28-b665-64f2615d7ce2'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Lock "cinder-7d00133c-8c1a-4e05-9612-0c32eb123186-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-7d00133c-8c1a-4e05-9612-0c32eb123186" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-7d00133c-8c1a-4e05-9612-0c32eb123186" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5705dc5c-496c-4f43-bb84-9a2a9007cc39]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:23 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:23 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:23 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 Jul 21 17:33:23 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Lock "cinder-9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-421ce34a-61bd-4937-9bbd-eaa6c58c9901" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-421ce34a-61bd-4937-9bbd-eaa6c58c9901" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Deleting offline snapshot 9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 of volume 421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] snapshot_file for this snap is: volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[86241992-3cd7-4acc-a94b-a2fa7f617486]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:24 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.317s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Deleted volume successfully. Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d1180237-86f3-4359-bab2-caa98fffe547 tempest-CinderUnicodeTest-739172846 None] Lock "cinder-038f4bca-7533-4f91-85b1-62ef3cd2cb96-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:24 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 Jul 21 17:33:24 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:24 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186" returned: 0 in 0.478s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:24 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186 Jul 21 17:33:24 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Flow 'volume_create_manager' (a8567c5b-d04c-40a3-bca0-9024d62994ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa75bbe-fcab-4931-b2b6-a2564d12c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa75bbe-fcab-4931-b2b6-a2564d12c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-144428100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7715b752-f99c-494a-a5a2-cd5f435f78c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d24ef7e998493f9a78aad45b0a996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:24Z,use_quota=True,user_id='6fb2c7aff1f44ccca3662f333725b67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47966bb4-4b44-4fbd-98e9-832ef2f57829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47966bb4-4b44-4fbd-98e9-832ef2f57829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7534f49e-8f06-43af-a740-dcd7e0c344c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7534f49e-8f06-43af-a740-dcd7e0c344c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7715b752-f99c-494a-a5a2-cd5f435f78c1', 'volume_name': 'volume-7715b752-f99c-494a-a5a2-cd5f435f78c1', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d0196b-2057-418a-bea9-0198c0f8670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d0196b-2057-418a-bea9-0198c0f8670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6aceb41-fec3-4e9b-9a85-c07947e06641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Volume 7715b752-f99c-494a-a5a2-cd5f435f78c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7715b752-f99c-494a-a5a2-cd5f435f78c1', 'volume_size': 1} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-144428100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7715b752-f99c-494a-a5a2-cd5f435f78c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d24ef7e998493f9a78aad45b0a996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:24Z,use_quota=True,user_id='6fb2c7aff1f44ccca3662f333725b67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Creating volume 7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:24 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:24 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 1073741824 Jul 21 17:33:24 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:24 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" returned: 0 in 0.447s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:24 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7d00133c-8c1a-4e05-9612-0c32eb123186" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6f17a9-64ab-4ccf-87e0-f38e2837f97e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-7d00133c-8c1a-4e05-9612-0c32eb123186" released by "delete_volume" :: held 0.842s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Created reservations ['cfc43c7f-baf8-4f47-bc00-0835dfb00cf0', 'd978464d-a97a-42ab-ad24-af1766e3f6f4', 'ca98fe6a-1ae3-4081-9ca1-1a136bc7a379', 'e88d85c8-8165-4a1f-a478-1688b12423c4'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:24 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 Jul 21 17:33:24 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:24 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:24 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:25 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901" returned: 0 in 0.447s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:25 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:25 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 1073741824" returned: 0 in 0.583s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:25 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 Jul 21 17:33:25 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-af7a0474-e59b-4dfa-8ad6-e1c709b0c45c tempest-ProjectMemberTests-1964957264 None] Lock "cinder-7d00133c-8c1a-4e05-9612-0c32eb123186-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:25 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:25 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:25 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.315s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6aceb41-fec3-4e9b-9a85-c07947e06641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7715b752-f99c-494a-a5a2-cd5f435f78c1', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1d5b4b-caae-4c58-acec-a4f0aa77eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Volume volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 (7715b752-f99c-494a-a5a2-cd5f435f78c1): created successfully Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1d5b4b-caae-4c58-acec-a4f0aa77eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Flow 'volume_create_manager' (a8567c5b-d04c-40a3-bca0-9024d62994ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (07a67739-efd1-4633-9bca-cb0247b0bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:25 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96232d5f-c4be-4f57-aa96-c6e5c531b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b262bd22-bda6-49c6-b765-d1a5645864a0 tempest-SnapshotDependencyTests-1039796160 None] Created volume successfully. Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" returned: 0 in 0.539s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96232d5f-c4be-4f57-aa96-c6e5c531b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355762491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08975945-f386-4fbf-ad87-a4500278dede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:25Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76e11ed-23ef-46e6-9a94-07845538fda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:25 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1 Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76e11ed-23ef-46e6-9a94-07845538fda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:25 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54396cf0-0c7f-48d2-8227-dad51ba93ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54396cf0-0c7f-48d2-8227-dad51ba93ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08975945-f386-4fbf-ad87-a4500278dede', 'volume_name': 'volume-08975945-f386-4fbf-ad87-a4500278dede', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85589bf-3377-4869-9803-b40757e38c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85589bf-3377-4869-9803-b40757e38c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7938291-c5d2-441e-ac7c-5a3b768e3523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Volume 08975945-f386-4fbf-ad87-a4500278dede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08975945-f386-4fbf-ad87-a4500278dede', 'volume_size': 1} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355762491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08975945-f386-4fbf-ad87-a4500278dede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:25Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Creating volume 08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:25 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:25 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede 1073741824 Jul 21 17:33:25 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:25 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901.9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" returned: 0 in 0.296s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1" released by "_delete_snapshot" :: held 1.851s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-421ce34a-61bd-4937-9bbd-eaa6c58c9901" released by "delete_snapshot" :: held 1.877s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:25 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Created reservations ['4ec1da38-c373-48e2-97d4-c695abd613ef', 'f3b45c14-7e68-4c82-9540-8f63a8f6e64f', '9a52a1b7-42d8-46a3-9527-b5fe9f1357c6', '683610a5-e7fe-4cd8-90f3-98df7af4d516'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Delete snapshot completed successfully. Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a95c5d87-2248-4b4f-a231-ab09d40b939e tempest-ProjectReaderTests-462039180 None] Lock "cinder-9f0f9c43-ded7-4d44-8f90-0661d6fcb4b1-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:26 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede 1073741824" returned: 0 in 0.502s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-421ce34a-61bd-4937-9bbd-eaa6c58c9901-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Lock "cinder-421ce34a-61bd-4937-9bbd-eaa6c58c9901-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:26 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede Jul 21 17:33:26 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-421ce34a-61bd-4937-9bbd-eaa6c58c9901" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-421ce34a-61bd-4937-9bbd-eaa6c58c9901" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9c6c5f-6a3b-4ed1-a97d-8de4aef19569]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:26 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 Jul 21 17:33:26 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:26 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7938291-c5d2-441e-ac7c-5a3b768e3523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08975945-f386-4fbf-ad87-a4500278dede', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c2e4e-7530-40cf-ac9b-7bae9f384620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:26 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Volume volume-08975945-f386-4fbf-ad87-a4500278dede (08975945-f386-4fbf-ad87-a4500278dede): created successfully Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c2e4e-7530-40cf-ac9b-7bae9f384620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (07a67739-efd1-4633-9bca-cb0247b0bf06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2976b4ff-0a6a-459f-8b45-bbe6a5813249 tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:33:26 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901" returned: 0 in 0.449s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:26 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901 Jul 21 17:33:26 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:27 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-421ce34a-61bd-4937-9bbd-eaa6c58c9901" returned: 0 in 0.277s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-421ce34a-61bd-4937-9bbd-eaa6c58c9901" released by "delete_volume" :: held 0.799s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Creating offline snapshot 1cbc721f-6c3f-4017-90c9-78b47dc6d55a of volume 7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7997d-19bc-489d-9da0-83e04b2b74e8]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Created reservations ['49553d49-7a60-47c8-8d0b-89ef5f7e2c3e', 'f42e7c31-5f02-445d-9948-529a4d44aa38', 'f0b506a0-e46f-4e57-bc7d-6a3ecb69fd46', 'dc028cbc-af5a-4683-9ca9-d89a9291fb35'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:27 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:27 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:27 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:27 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:27 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.301s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:27 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Deleted volume successfully. Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-d0554806-6624-4ca3-9a05-24aeb44a3ceb tempest-ProjectReaderTests-462039180 None] Lock "cinder-421ce34a-61bd-4937-9bbd-eaa6c58c9901-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:27 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.474s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:27 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a 1G Jul 21 17:33:27 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (b772f7e3-b8fc-49d6-9f22-806caf6d648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bbbf3e-801b-4c92-940f-b7246899cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bbbf3e-801b-4c92-940f-b7246899cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581477786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481fca32-c0fa-4e6a-86ae-9bc344ded8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:28Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fbd9ca-136b-46ca-adaa-0cec923f660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fbd9ca-136b-46ca-adaa-0cec923f660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cc2ec2-309e-4426-b12b-5265f8bbf260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cc2ec2-309e-4426-b12b-5265f8bbf260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481fca32-c0fa-4e6a-86ae-9bc344ded8f2', 'volume_name': 'volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637482f5-9d19-447c-be5f-3071e857b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637482f5-9d19-447c-be5f-3071e857b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb793844-3617-4093-8a93-3d2bfad22ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:28 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:28 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Volume 481fca32-c0fa-4e6a-86ae-9bc344ded8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2', 'volume_size': 1} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a 1G" returned: 0 in 0.554s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:28 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a Jul 21 17:33:28 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:28 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a" returned: 0 in 0.306s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:28 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a is being set with open permissions: ugo+rw Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:28 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a Jul 21 17:33:28 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-379eaed5-28c3-4e06-89a8-550e5b0acec3 tempest-ProjectAdminTests-1761646938 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 17:33:28 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a" returned: 0 in 0.251s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:28 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info Jul 21 17:33:28 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:28 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:28 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info is being set with open permissions: ugo+rw Jul 21 17:33:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:29 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info Jul 21 17:33:29 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:29 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.info" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.211s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 of volume 08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:29 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2a575ccf-e9ad-4ab9-a939-660fac098992 tempest-SnapshotDependencyTests-1039796160 None] Create snapshot completed successfully Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a0b75-b6ac-41a8-84e1-4e371367a290]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:29 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede Jul 21 17:33:29 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:29 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede" returned: 0 in 0.385s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:29 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 1G Jul 21 17:33:29 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:30 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 1G" returned: 0 in 0.438s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08975945-f386-4fbf-ad87-a4500278dede -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:30 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08975945-f386-4fbf-ad87-a4500278dede -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 Jul 21 17:33:30 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:30 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08975945-f386-4fbf-ad87-a4500278dede -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:30 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 is being set with open permissions: ugo+rw Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:30 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 Jul 21 17:33:30 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:30 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" returned: 0 in 0.292s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:30 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info Jul 21 17:33:30 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Flow 'volume_create_manager' (c899e5f2-6cff-49f8-8837-915e7814fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b91f216-cf4f-41a4-8dee-5113d5f2ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b91f216-cf4f-41a4-8dee-5113d5f2ba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2016c5ce-7604-4734-be95-328a993ae46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d24ef7e998493f9a78aad45b0a996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1cbc721f-6c3f-4017-90c9-78b47dc6d55a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:31Z,use_quota=True,user_id='6fb2c7aff1f44ccca3662f333725b67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3d1c61-c76f-4c84-8ce3-f05456add347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3d1c61-c76f-4c84-8ce3-f05456add347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ec54eb-fa2a-4df0-9ab1-f1e1edba9d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ec54eb-fa2a-4df0-9ab1-f1e1edba9d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2016c5ce-7604-4734-be95-328a993ae46b', 'volume_name': 'volume-2016c5ce-7604-4734-be95-328a993ae46b', 'volume_size': 1, 'snapshot_id': '1cbc721f-6c3f-4017-90c9-78b47dc6d55a'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ba72da-9983-4a5d-9969-caa7b13b57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ba72da-9983-4a5d-9969-caa7b13b57e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67c15e0-21e7-41db-bb38-610ce0475e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:30 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Volume 2016c5ce-7604-4734-be95-328a993ae46b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2016c5ce-7604-4734-be95-328a993ae46b', 'volume_size': 1, 'snapshot_id': '1cbc721f-6c3f-4017-90c9-78b47dc6d55a'} Jul 21 17:33:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:31 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info" returned: 0 in 0.282s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:31 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info is being set with open permissions: ugo+rw Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:31 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info Jul 21 17:33:31 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:31 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.info" returned: 0 in 0.259s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581477786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481fca32-c0fa-4e6a-86ae-9bc344ded8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:28Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Creating volume 481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:31 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:31 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 1073741824 Jul 21 17:33:31 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9760c035-4901-4303-b54a-9a0ba22884bb tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:33:31 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 1073741824" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:31 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 Jul 21 17:33:31 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-08975945-f386-4fbf-ad87-a4500278dede" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-08975945-f386-4fbf-ad87-a4500278dede" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:32 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" returned: 0 in 0.288s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 of volume 08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.202s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-quobyte-1cbc721f-6c3f-4017-90c9-78b47dc6d55a-2016c5ce-7604-4734-be95-328a993ae46b" by "_create_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb793844-3617-4093-8a93-3d2bfad22ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23862544-3d00-43ac-8539-3f2b7a2a61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f823829f-6283-4ed9-a2c9-d53baa30e23b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-1cbc721f-6c3f-4017-90c9-78b47dc6d55a-2016c5ce-7604-4734-be95-328a993ae46b" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Creating volume 2016c5ce-7604-4734-be95-328a993ae46b from snapshot 1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-quobyte-2016c5ce-7604-4734-be95-328a993ae46b" by "_copy_volume_from_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:32 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Volume volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 (481fca32-c0fa-4e6a-86ae-9bc344ded8f2): created successfully Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23862544-3d00-43ac-8539-3f2b7a2a61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (b772f7e3-b8fc-49d6-9f22-806caf6d648b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-2016c5ce-7604-4734-be95-328a993ae46b" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] snapshot: 1cbc721f-6c3f-4017-90c9-78b47dc6d55a, volume: 2016c5ce-7604-4734-be95-328a993ae46b, {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:32 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 Jul 21 17:33:32 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:32 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c8e668c3-ceb8-448d-833b-40e9fbf62c92 tempest-ProjectReaderTests-462039180 None] Created volume successfully. Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa7fe3-0cc0-4002-a142-ed6e14c3a162]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:32 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a Jul 21 17:33:32 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:32 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" returned: 0 in 0.432s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08975945-f386-4fbf-ad87-a4500278dede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[95745170-dbb6-4b8e-992c-ef3e66099f7b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:32 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a" returned: 0 in 0.390s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7715b752-f99c-494a-a5a2-cd5f435f78c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Creating direct copy from snapshot {{(pid=87591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 17:33:32 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede Jul 21 17:33:32 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dd1c1e-1871-4f02-9d25-1a73287b8c3d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:32 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:32 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:32 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:33 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede" returned: 0 in 0.372s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:33 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 Jul 21 17:33:33 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:33 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG cinder.utils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Path /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b not found in is_blk_device check {{(pid=87591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:33 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b Jul 21 17:33:33 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:33 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" returned: 0 in 0.420s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:33 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5 Jul 21 17:33:33 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:33 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede.bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" returned: 0 in 0.382s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5" released by "_delete_snapshot" :: held 1.785s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:33 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-08975945-f386-4fbf-ad87-a4500278dede" released by "delete_snapshot" :: held 1.841s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Created reservations ['64833c2d-19ba-47be-830e-1d0de6b8cece', '08d5ec42-1ec6-4149-9d57-eaeddbd879d3', '5ba24abe-9a89-48ea-b142-56103a6e734e', '1f067b0d-c996-4f4b-a003-f95ccf02ff68'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:34 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e04ac524-5d79-44d9-8c59-c8f1482fbe97 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-bb3c8c8c-bae3-43f6-8f4b-efe800d25ff5-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-08975945-f386-4fbf-ad87-a4500278dede-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-08975945-f386-4fbf-ad87-a4500278dede-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-08975945-f386-4fbf-ad87-a4500278dede" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-08975945-f386-4fbf-ad87-a4500278dede" acquired by "delete_volume" :: waited 0.043s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[606573b3-873a-46d0-b702-e5ce742e1d28]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:34 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:35 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede Jul 21 17:33:35 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:35 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede" returned: 0 in 1.082s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:35 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:36 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede Jul 21 17:33:36 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:36 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:36 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-08975945-f386-4fbf-ad87-a4500278dede" returned: 0 in 0.982s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:36 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-08975945-f386-4fbf-ad87-a4500278dede" released by "delete_volume" :: held 2.233s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Created reservations ['676ecd69-7fbb-4f86-bdc9-018ec2449222', 'f14bed46-ec23-4091-a8d3-9758279a9ead', 'c35311cd-02d6-4622-aaac-32cec995b7b0', '1193407d-1138-460f-8726-d3532ae60d10'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:37 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:37 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:37 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.617s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:37 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:37 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-e9d69356-dc98-424a-84c7-fcaf20ce7591 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-08975945-f386-4fbf-ad87-a4500278dede-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:38 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b" returned: 0 in 5.196s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ddac9-72dd-4ca1-9e01-a651eadadd49]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:38 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:38 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (33d05eea-4391-491c-a904-e70f379c147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1b3496-7de3-44e8-8eb0-89db61772c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1b3496-7de3-44e8-8eb0-89db61772c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94163875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016a7557-c643-4934-8bc7-2d484ed789cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:39Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3f861f-4123-4a23-8409-66ebcd4ffff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3f861f-4123-4a23-8409-66ebcd4ffff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5740018b-db7f-43d7-84f8-ecceb082bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5740018b-db7f-43d7-84f8-ecceb082bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016a7557-c643-4934-8bc7-2d484ed789cc', 'volume_name': 'volume-016a7557-c643-4934-8bc7-2d484ed789cc', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097f6da6-25d2-492b-a81d-ccdce73d67f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097f6da6-25d2-492b-a81d-ccdce73d67f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b566674d-52dd-4d06-8107-a9bce191c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:38 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Volume 016a7557-c643-4934-8bc7-2d484ed789cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016a7557-c643-4934-8bc7-2d484ed789cc', 'volume_size': 1} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:38 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.560s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG cinder.image.image_utils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b {{(pid=87591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 17:33:38 devstack cinder-volume[87591]: INFO cinder.image.image_utils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Converted 1024.00 MB image at 197.03 MB/s Jul 21 17:33:38 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b is being set with open permissions: ugo+rw Jul 21 17:33:38 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:38 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b Jul 21 17:33:38 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:39 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b" returned: 0 in 0.251s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-2016c5ce-7604-4734-be95-328a993ae46b" released by "_copy_volume_from_snapshot" :: held 6.891s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-1cbc721f-6c3f-4017-90c9-78b47dc6d55a-2016c5ce-7604-4734-be95-328a993ae46b" released by "_create_volume_from_snapshot" :: held 6.963s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.019s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.702s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Creating offline snapshot d3de2d73-a95a-4cd0-8c57-17184c14c430 of volume 481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67c15e0-21e7-41db-bb38-610ce0475e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2016c5ce-7604-4734-be95-328a993ae46b', 'volume_size': 1, 'snapshot_id': '1cbc721f-6c3f-4017-90c9-78b47dc6d55a'}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90397178-d63f-44bd-bd14-51104865f030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192c5ae-a115-45ae-a917-4fd4411fe78b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:39 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Volume volume-2016c5ce-7604-4734-be95-328a993ae46b (2016c5ce-7604-4734-be95-328a993ae46b): created successfully Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90397178-d63f-44bd-bd14-51104865f030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Flow 'volume_create_manager' (c899e5f2-6cff-49f8-8837-915e7814fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:39 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f016d9f0-3455-4eb3-a613-0eb145de52a4 tempest-SnapshotDependencyTests-1039796160 None] Created volume successfully. Jul 21 17:33:39 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 Jul 21 17:33:39 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:39 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" returned: 0 in 0.413s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:39 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 1G Jul 21 17:33:39 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-1cbc721f-6c3f-4017-90c9-78b47dc6d55a-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-1cbc721f-6c3f-4017-90c9-78b47dc6d55a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-quobyte-7715b752-f99c-494a-a5a2-cd5f435f78c1" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-7715b752-f99c-494a-a5a2-cd5f435f78c1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-quobyte-1cbc721f-6c3f-4017-90c9-78b47dc6d55a" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-1cbc721f-6c3f-4017-90c9-78b47dc6d55a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Deleting offline snapshot 1cbc721f-6c3f-4017-90c9-78b47dc6d55a of volume 7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] snapshot_file for this snap is: volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ce8a5-1091-4fd7-bec4-ad58f30ee6e4]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:39 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:40 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a Jul 21 17:33:40 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:40 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 1G" returned: 0 in 0.524s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:40 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 Jul 21 17:33:40 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:40 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a" returned: 0 in 0.441s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7715b752-f99c-494a-a5a2-cd5f435f78c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1e635-7e1e-41b6-86c4-5f8f900fb26b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:40 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430" returned: 0 in 0.312s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:40 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 is being set with open permissions: ugo+rw Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:40 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:40 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:40 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 Jul 21 17:33:40 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:40 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:40 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.416s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:40 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:40 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info Jul 21 17:33:40 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:40 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a Jul 21 17:33:40 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:41 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info" returned: 0 in 0.298s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:41 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info is being set with open permissions: ugo+rw Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:41 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info Jul 21 17:33:41 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:41 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a" returned: 0 in 0.401s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:41 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a Jul 21 17:33:41 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:41 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.info" returned: 0 in 0.264s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.505s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94163875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016a7557-c643-4934-8bc7-2d484ed789cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:39Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Creating volume 016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:41 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:41 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc 1073741824 Jul 21 17:33:41 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b5eb8f0e-60ea-48e2-b411-166284b246fe tempest-ProjectReaderTests-462039180 None] Create snapshot completed successfully Jul 21 17:33:41 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1.1cbc721f-6c3f-4017-90c9-78b47dc6d55a" returned: 0 in 0.283s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-1cbc721f-6c3f-4017-90c9-78b47dc6d55a" released by "_delete_snapshot" :: held 1.658s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-7715b752-f99c-494a-a5a2-cd5f435f78c1" released by "delete_snapshot" :: held 1.681s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Created reservations ['39d48bde-777c-4bb2-b1d0-0d179a807261', 'ec8651fd-cdbd-4ec8-9644-b159294dcf72', '4e91e193-2347-4e49-8d51-f4b6164eff01', '01829cfb-a321-4e3c-a9ba-8aa5b71d6dc1'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:41 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Delete snapshot completed successfully. Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-97e8e3cd-ab13-4017-866d-4a7e7e362f7a tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-1cbc721f-6c3f-4017-90c9-78b47dc6d55a-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:41 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc 1073741824" returned: 0 in 0.505s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:41 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:41 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc Jul 21 17:33:41 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-7715b752-f99c-494a-a5a2-cd5f435f78c1-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-7715b752-f99c-494a-a5a2-cd5f435f78c1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-quobyte-7715b752-f99c-494a-a5a2-cd5f435f78c1" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-7715b752-f99c-494a-a5a2-cd5f435f78c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:42 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:42 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-d3de2d73-a95a-4cd0-8c57-17184c14c430-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66704ecc-3ecb-46a7-b2d9-14218fb6883d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Lock "cinder-d3de2d73-a95a-4cd0-8c57-17184c14c430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-d3de2d73-a95a-4cd0-8c57-17184c14c430" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:42 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc" returned: 0 in 0.364s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b566674d-52dd-4d06-8107-a9bce191c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016a7557-c643-4934-8bc7-2d484ed789cc', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946d7a99-5459-4753-89b8-9cc7da9b5b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-d3de2d73-a95a-4cd0-8c57-17184c14c430" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Deleting offline snapshot d3de2d73-a95a-4cd0-8c57-17184c14c430 of volume 481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] snapshot_file for this snap is: volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d20af-5282-4423-81f9-8552cabf11d9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:42 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Volume volume-016a7557-c643-4934-8bc7-2d484ed789cc (016a7557-c643-4934-8bc7-2d484ed789cc): created successfully Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946d7a99-5459-4753-89b8-9cc7da9b5b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:42 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:42 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (33d05eea-4391-491c-a904-e70f379c147e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:42 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-044c728b-61a3-4ee8-9b6f-b848a47820f2 tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:33:42 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.384s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 17:33:42 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 Jul 21 17:33:42 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:42 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.471s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:42 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1 Jul 21 17:33:42 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:42 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430" returned: 0 in 0.436s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af2e985-e4f1-4899-8b31-e3776c03a7e7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:43 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-7715b752-f99c-494a-a5a2-cd5f435f78c1" returned: 0 in 0.288s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-7715b752-f99c-494a-a5a2-cd5f435f78c1" released by "delete_volume" :: held 0.857s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:43 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 Jul 21 17:33:43 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Created reservations ['0449027b-47db-477f-9a18-f99aa41ae470', 'c4ed749c-2942-4ad2-9ddd-0185a7d047fa', '709bd768-888d-4ba9-b173-f7eb044c4b33', '51789f32-7aa7-40d4-839c-2e46eabe90db'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot 90928f46-0f6d-4f67-a157-b79fde078bbe of volume 016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedf3231-9ac4-474d-af66-6318245feb14]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:43 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:43 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:43 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" returned: 0 in 0.467s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:43 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 Jul 21 17:33:43 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:43 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc Jul 21 17:33:43 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:43 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.392s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:43 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Deleted volume successfully. Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-00d0fb43-6474-4b0e-aa40-ff4f2b7bd992 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-7715b752-f99c-494a-a5a2-cd5f435f78c1-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:43 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc" returned: 0 in 0.448s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:43 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe 1G Jul 21 17:33:43 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:43 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430" returned: 0 in 0.472s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:43 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:43 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430 Jul 21 17:33:43 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:44 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2.d3de2d73-a95a-4cd0-8c57-17184c14c430" returned: 0 in 0.296s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-d3de2d73-a95a-4cd0-8c57-17184c14c430" released by "_delete_snapshot" :: held 1.825s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" released by "delete_snapshot" :: held 1.888s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:44 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe 1G" returned: 0 in 0.503s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-016a7557-c643-4934-8bc7-2d484ed789cc -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:44 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-016a7557-c643-4934-8bc7-2d484ed789cc -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe Jul 21 17:33:44 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Created reservations ['83a3b700-ee37-4dfa-9e56-a43a989adfed', '80f37ebb-100d-468e-919e-51aee42c1764', '547985c9-4a4c-4395-b539-519bf9c416ff', 'eaf9f04c-6f1c-498f-831c-9f12ff7671b4'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:44 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Delete snapshot completed successfully. Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6b2625b2-c16b-4d04-9d63-26e21f588571 tempest-ProjectReaderTests-462039180 None] Lock "cinder-d3de2d73-a95a-4cd0-8c57-17184c14c430-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-2016c5ce-7604-4734-be95-328a993ae46b-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-2016c5ce-7604-4734-be95-328a993ae46b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "cinder-quobyte-2016c5ce-7604-4734-be95-328a993ae46b" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-2016c5ce-7604-4734-be95-328a993ae46b" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2c91ff-e880-4e52-8d24-a53740fbafac]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:44 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b Jul 21 17:33:44 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:44 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-016a7557-c643-4934-8bc7-2d484ed789cc -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe" returned: 0 in 0.407s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:44 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe is being set with open permissions: ugo+rw Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:44 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe Jul 21 17:33:44 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:44 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:44 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b" returned: 0 in 0.407s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:44 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b Jul 21 17:33:44 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:44 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:45 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info Jul 21 17:33:45 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:45 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-2016c5ce-7604-4734-be95-328a993ae46b" returned: 0 in 0.266s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-quobyte-2016c5ce-7604-4734-be95-328a993ae46b" released by "delete_volume" :: held 0.728s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:45 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info" returned: 0 in 0.270s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:45 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info is being set with open permissions: ugo+rw Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:45 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info Jul 21 17:33:45 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Created reservations ['4b0feb8f-b320-4340-a20d-f3174848fbff', '932459d1-c718-4c8e-b430-d898c24c98bc', '467e1bd4-e182-491a-8f9b-17b7bad0b65f', '2e5ff90f-3127-41de-bfb5-ae91e695c960'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:45 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:45 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-481fca32-c0fa-4e6a-86ae-9bc344ded8f2-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Lock "cinder-481fca32-c0fa-4e6a-86ae-9bc344ded8f2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" acquired by "delete_volume" :: waited 0.054s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:45 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.info" returned: 0 in 0.485s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:45 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a277bbcf-1fb1-4dfa-b281-26ef5bc42111]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Deleted volume successfully. Jul 21 17:33:45 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-7a050804-0200-4250-b9ba-e6d812b1f9f7 tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:33:45 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-f04f443f-8ab2-4e94-9feb-e3efb2932c65 tempest-SnapshotDependencyTests-1039796160 None] Lock "cinder-2016c5ce-7604-4734-be95-328a993ae46b-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:45 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 Jul 21 17:33:45 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:46 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" returned: 0 in 0.428s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:46 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2 Jul 21 17:33:46 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-90928f46-0f6d-4f67-a157-b79fde078bbe-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-90928f46-0f6d-4f67-a157-b79fde078bbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-016a7557-c643-4934-8bc7-2d484ed789cc" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-016a7557-c643-4934-8bc7-2d484ed789cc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-90928f46-0f6d-4f67-a157-b79fde078bbe" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-90928f46-0f6d-4f67-a157-b79fde078bbe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot 90928f46-0f6d-4f67-a157-b79fde078bbe of volume 016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd3f540-9a7c-4776-b320-8301aa00c60c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:46 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" returned: 0 in 0.338s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-481fca32-c0fa-4e6a-86ae-9bc344ded8f2" released by "delete_volume" :: held 0.866s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Created reservations ['02904d79-eb85-4643-8cd3-20d98ae4af74', '5cd60a01-9d59-4fcb-9c7d-de85b929199e', '8b4ef11d-4313-4f95-b1cf-3d68311be7b0', '8f50a4f1-7085-4c7d-b82f-eceda9a14719'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:46 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe Jul 21 17:33:46 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:46 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:46 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:46 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe" returned: 0 in 0.412s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-016a7557-c643-4934-8bc7-2d484ed789cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173f634-4e2b-479c-ac15-1e2de76a3288]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:46 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:47 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.283s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:47 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Deleted volume successfully. Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-0cf6df6a-fbdd-4ce2-a4e9-30d2426e2a24 tempest-ProjectReaderTests-462039180 None] Lock "cinder-481fca32-c0fa-4e6a-86ae-9bc344ded8f2-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:47 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc Jul 21 17:33:47 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (e5ba6a8e-a752-4447-8a42-80339b2b5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67874615-ee07-4b2c-96f2-f7039d1d4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67874615-ee07-4b2c-96f2-f7039d1d4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137953331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be8dfd1-52e4-40b4-95a1-bb66d1ad8393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:47Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd60fff-3d72-4ea2-84b7-806eca2a6e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd60fff-3d72-4ea2-84b7-806eca2a6e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44218771-cb93-4bb9-95f0-489e3415a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44218771-cb93-4bb9-95f0-489e3415a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be8dfd1-52e4-40b4-95a1-bb66d1ad8393', 'volume_name': 'volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4f0776-4f2f-47e2-92cf-0042dd99b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4f0776-4f2f-47e2-92cf-0042dd99b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:47 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1a201b-ff84-4266-b6a4-ea8639a9b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:47 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Volume 5be8dfd1-52e4-40b4-95a1-bb66d1ad8393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393', 'volume_size': 1} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137953331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be8dfd1-52e4-40b4-95a1-bb66d1ad8393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e034fdc66b04d0cb276366d337c0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:47Z,use_quota=True,user_id='acca851531f345fdb48fc827e72055bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Creating volume 5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:47 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc" returned: 0 in 0.500s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:47 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 1073741824 Jul 21 17:33:47 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:47 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe Jul 21 17:33:47 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:47 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe" returned: 0 in 0.364s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:47 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe Jul 21 17:33:47 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:47 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 1073741824" returned: 0 in 0.457s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:47 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:47 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 Jul 21 17:33:47 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:48 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc.90928f46-0f6d-4f67-a157-b79fde078bbe" returned: 0 in 0.274s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-90928f46-0f6d-4f67-a157-b79fde078bbe" released by "_delete_snapshot" :: held 1.690s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-016a7557-c643-4934-8bc7-2d484ed789cc" released by "delete_snapshot" :: held 1.716s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Created reservations ['497db56a-452e-4761-b3cd-fc9be6f93731', 'e6833e68-273d-4ae3-bb0e-54eb19638a28', 'cef473b8-6e44-4f31-9e92-8a755c724166', '4ef34323-ded5-4024-bf90-ceec0e0b90dc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:48 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" returned: 0 in 0.329s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1a201b-ff84-4266-b6a4-ea8639a9b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c8e4a0-170b-4065-8ad0-1e4be024db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:48 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Volume volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 (5be8dfd1-52e4-40b4-95a1-bb66d1ad8393): created successfully Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c8e4a0-170b-4065-8ad0-1e4be024db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Flow 'volume_create_manager' (e5ba6a8e-a752-4447-8a42-80339b2b5640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-166a6bac-c368-4ea2-be2a-fe76b46b98a8 tempest-ProjectReaderTests-462039180 None] Created volume successfully. Jul 21 17:33:48 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-92ff3ed4-9217-4251-82bc-300d75ede5d4 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-90928f46-0f6d-4f67-a157-b79fde078bbe-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-016a7557-c643-4934-8bc7-2d484ed789cc-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Lock "cinder-016a7557-c643-4934-8bc7-2d484ed789cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-016a7557-c643-4934-8bc7-2d484ed789cc" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-016a7557-c643-4934-8bc7-2d484ed789cc" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b8f3d3-9cf3-4dbb-9bb2-1e3d15b9728b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:48 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:48 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc Jul 21 17:33:48 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:49 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc" returned: 0 in 0.365s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:49 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc Jul 21 17:33:49 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:49 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-016a7557-c643-4934-8bc7-2d484ed789cc" returned: 0 in 0.329s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-016a7557-c643-4934-8bc7-2d484ed789cc" released by "delete_volume" :: held 0.769s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Created reservations ['18fc261f-3987-4446-8b92-dfa48aa7c2c1', '774c3a56-38fa-4332-9f15-f8243aae3829', '4f7ca745-c43c-4a30-9950-37d673a816a1', '5703850f-220a-4c6f-b74d-c51da6aea1ed'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:49 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:49 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Creating offline snapshot ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc of volume 5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e8366d-c6a3-4798-8cea-ce699f42585a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:49 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.313s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:49 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:33:49 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-621557e9-a3d7-4245-adc7-5a0464b878cf tempest-ProjectMemberTests-1964957264 None] Lock "cinder-016a7557-c643-4934-8bc7-2d484ed789cc-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:50 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 Jul 21 17:33:50 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:50 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" returned: 0 in 0.394s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:50 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc 1G Jul 21 17:33:50 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (afa8284c-2ff0-4cee-a7be-005d755225b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75744708-9cd7-4e10-9033-15bc35cb1d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75744708-9cd7-4e10-9033-15bc35cb1d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278330816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae726b8-bc11-4b26-a9bc-8d1dd292b440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:50Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31be34b-ebb8-415e-99c4-91fe3732a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31be34b-ebb8-415e-99c4-91fe3732a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f049d2d-bef8-452c-8f1f-61f45fa500bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f049d2d-bef8-452c-8f1f-61f45fa500bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae726b8-bc11-4b26-a9bc-8d1dd292b440', 'volume_name': 'volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5cedcd-98cc-403c-bfa7-e9467c702120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5cedcd-98cc-403c-bfa7-e9467c702120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38b8e7b-1a11-4ded-9a51-475af2f88aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:50 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Volume aae726b8-bc11-4b26-a9bc-8d1dd292b440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440', 'volume_size': 1} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:50 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc 1G" returned: 0 in 0.438s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:50 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:50 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc Jul 21 17:33:50 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:51 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" returned: 0 in 0.296s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:51 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc is being set with open permissions: ugo+rw Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:51 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc Jul 21 17:33:51 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:51 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" returned: 0 in 0.276s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:51 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info Jul 21 17:33:51 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:51 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:51 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info is being set with open permissions: ugo+rw Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:51 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info Jul 21 17:33:51 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:51 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.info" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278330816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae726b8-bc11-4b26-a9bc-8d1dd292b440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:33:50Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Creating volume aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:33:51 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:33:51 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:51 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 1073741824 Jul 21 17:33:51 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:51 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-094b834f-9d9b-461e-82ec-94886504f11c tempest-ProjectReaderTests-462039180 None] Create snapshot completed successfully Jul 21 17:33:52 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 1073741824" returned: 0 in 0.462s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:52 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 Jul 21 17:33:52 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:52 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440" returned: 0 in 0.317s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38b8e7b-1a11-4ded-9a51-475af2f88aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512f8c9e-966b-48aa-9b4b-2324654999b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:33:52 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Volume volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 (aae726b8-bc11-4b26-a9bc-8d1dd292b440): created successfully Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512f8c9e-966b-48aa-9b4b-2324654999b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (afa8284c-2ff0-4cee-a7be-005d755225b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:33:52 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-b9b31b7c-4d19-461e-b918-4d396d3b35ad tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Lock "cinder-ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:52 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Deleting offline snapshot ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc of volume 5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] snapshot_file for this snap is: volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845228c-2d47-4b32-8fd4-aa608c532128]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:53 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc Jul 21 17:33:53 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:53 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" returned: 0 in 0.397s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc97a84e-8416-47a7-bba8-9b26fa225ba6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:53 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 Jul 21 17:33:53 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot c396a0ae-b093-4254-ae2e-b2c0176b2bd3 of volume aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cff873-3cf7-4428-bcfd-9e16e4b519c3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:53 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 Jul 21 17:33:53 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:53 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" returned: 0 in 0.412s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:53 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:53 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc Jul 21 17:33:53 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:54 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:54 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 1G Jul 21 17:33:54 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:54 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" returned: 0 in 0.402s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:54 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc Jul 21 17:33:54 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:54 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393.ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" returned: 0 in 0.290s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:54 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 1G" returned: 0 in 0.501s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc" released by "_delete_snapshot" :: held 1.628s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" released by "delete_snapshot" :: held 1.653s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:54 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 Jul 21 17:33:54 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Created reservations ['31f040ec-df7e-4720-a24e-709370ae2ffc', '94fa70ff-160a-4f97-8fa1-b7b2e3d6f253', '3b961095-b86d-4920-a1d8-68d6cae57a17', '9c0d7f40-9b36-4747-b424-c8857e76c213'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:54 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Delete snapshot completed successfully. Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-45acfda9-3731-4a68-8044-f5324b075f02 tempest-ProjectReaderTests-462039180 None] Lock "cinder-ba5b19ca-93b0-4fe4-a9e6-f13a5f4a71cc-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:54 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3" returned: 0 in 0.328s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:54 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 is being set with open permissions: ugo+rw Jul 21 17:33:54 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:54 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 Jul 21 17:33:54 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Lock "cinder-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Acquiring lock "cinder-quobyte-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" acquired by "delete_volume" :: waited 0.027s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:55 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3" returned: 0 in 0.300s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7094665-854b-45b1-9a1d-20e0bcca84d7]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:55 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info Jul 21 17:33:55 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:55 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 Jul 21 17:33:55 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:55 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info" returned: 0 in 0.263s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:55 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info is being set with open permissions: ugo+rw Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:55 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info Jul 21 17:33:55 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:55 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" returned: 0 in 0.366s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:55 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393 Jul 21 17:33:55 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:55 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.info" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:55 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-499ea329-20a3-46be-9709-31f26319cd2d tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:33:55 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" returned: 0 in 0.247s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Lock "cinder-quobyte-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393" released by "delete_volume" :: held 0.687s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:55 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Created reservations ['fec7e20a-d707-4a49-bc05-e7ba06287e72', '7e8043c9-6cd1-4d69-b4ee-43a2a4bf23ea', 'd3c72ee3-3a07-4106-89bc-965097916a3e', 'eec138f5-ab0f-4cfc-b56a-e8dce946c6bc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:56 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:56 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:56 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.239s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:33:56 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Deleted volume successfully. Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a31919a3-4104-47e0-85ca-3640e4a53e05 tempest-ProjectReaderTests-462039180 None] Lock "cinder-5be8dfd1-52e4-40b4-95a1-bb66d1ad8393-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-c396a0ae-b093-4254-ae2e-b2c0176b2bd3-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-c396a0ae-b093-4254-ae2e-b2c0176b2bd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-aae726b8-bc11-4b26-a9bc-8d1dd292b440" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-aae726b8-bc11-4b26-a9bc-8d1dd292b440" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-c396a0ae-b093-4254-ae2e-b2c0176b2bd3" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-c396a0ae-b093-4254-ae2e-b2c0176b2bd3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot c396a0ae-b093-4254-ae2e-b2c0176b2bd3 of volume aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc52d46a-f941-4bba-9570-d21d15ee34a9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:56 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:57 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 Jul 21 17:33:57 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:57 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:57 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:33:57 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ae075-3209-4d86-bcdd-d88f0608a9a9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:57 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 Jul 21 17:33:57 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:57 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440" returned: 0 in 0.383s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:57 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:57 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 Jul 21 17:33:57 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:58 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3" returned: 0 in 0.340s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:58 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3 Jul 21 17:33:58 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:58 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440.c396a0ae-b093-4254-ae2e-b2c0176b2bd3" returned: 0 in 0.245s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-c396a0ae-b093-4254-ae2e-b2c0176b2bd3" released by "_delete_snapshot" :: held 1.438s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-aae726b8-bc11-4b26-a9bc-8d1dd292b440" released by "delete_snapshot" :: held 1.460s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Created reservations ['fd2620c1-77fd-4f18-ae91-1f21f1e7226a', '3b038f39-8b34-4925-8392-6b507261285e', '5695c7a6-f07a-4ea4-ad2a-5d687e36153f', 'f563e442-7e18-4ae5-86b4-77eb86bdf4f0'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:58 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:33:58 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a3c1b656-3af9-4c74-a147-31bc979798e5 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-c396a0ae-b093-4254-ae2e-b2c0176b2bd3-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-aae726b8-bc11-4b26-a9bc-8d1dd292b440-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-aae726b8-bc11-4b26-a9bc-8d1dd292b440-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-aae726b8-bc11-4b26-a9bc-8d1dd292b440" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-aae726b8-bc11-4b26-a9bc-8d1dd292b440" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b420e844-ef7f-4eda-a269-6869fa0825c6]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:59 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 Jul 21 17:33:59 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:59 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440" returned: 0 in 0.378s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:59 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440 Jul 21 17:33:59 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:33:59 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-aae726b8-bc11-4b26-a9bc-8d1dd292b440" returned: 0 in 0.248s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-aae726b8-bc11-4b26-a9bc-8d1dd292b440" released by "delete_volume" :: held 0.696s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Created reservations ['608e4430-2b17-4281-9e2b-6bef34df890d', 'b0d7e431-2152-48c2-889f-ea0b169b690a', 'b220064a-30cf-43d2-b580-41ef06d84b6b', 'd84c61dc-c2e6-4b77-905a-46b5a04930aa'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:33:59 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:33:59 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:33:59 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:00 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.249s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:00 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-5c1b4e37-85fb-4f7a-bf76-9ec9f8cc3621 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-aae726b8-bc11-4b26-a9bc-8d1dd292b440-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (0330da07-aa42-4c17-9866-fb44bb0692d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9c122d-b2fd-4b87-a539-b3e7b731900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9c122d-b2fd-4b87-a539-b3e7b731900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860171307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1caeb1be-b3aa-4daf-9cf9-55296ce770a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:01Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8414c23b-2d32-4fb5-87c0-2f70d4038ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8414c23b-2d32-4fb5-87c0-2f70d4038ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7885e83b-8517-4fc1-b5ec-f5995a92a992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7885e83b-8517-4fc1-b5ec-f5995a92a992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1caeb1be-b3aa-4daf-9cf9-55296ce770a0', 'volume_name': 'volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78ca7ec-5a9e-41f9-9db2-cff32521fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78ca7ec-5a9e-41f9-9db2-cff32521fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a61146-3650-4283-95c9-50c83babc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:00 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Volume 1caeb1be-b3aa-4daf-9cf9-55296ce770a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0', 'volume_size': 1} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860171307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1caeb1be-b3aa-4daf-9cf9-55296ce770a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:01Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Creating volume 1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:00 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:00 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:00 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 1073741824 Jul 21 17:34:00 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:01 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 1073741824" returned: 0 in 0.427s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:01 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 Jul 21 17:34:01 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:01 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" returned: 0 in 0.256s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a61146-3650-4283-95c9-50c83babc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fbd491-60d5-4431-8c73-3ee3823263fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:01 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Volume volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 (1caeb1be-b3aa-4daf-9cf9-55296ce770a0): created successfully Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fbd491-60d5-4431-8c73-3ee3823263fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:01 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (0330da07-aa42-4c17-9866-fb44bb0692d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:01 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-747b094e-dc5a-4b6e-aff1-d3c84cb232f8 tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot 97c2e740-cb00-4ebf-b4b8-e966154d5798 of volume 1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5364595d-e294-47e2-a0a6-4652dd685212]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:02 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 Jul 21 17:34:02 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:02 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" returned: 0 in 0.341s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:02 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 1G Jul 21 17:34:02 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:02 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 1G" returned: 0 in 0.385s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:02 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:02 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 Jul 21 17:34:02 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:03 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798" returned: 0 in 0.298s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:03 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 is being set with open permissions: ugo+rw Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:03 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 Jul 21 17:34:03 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:03 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:03 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info Jul 21 17:34:03 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:03 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info" returned: 0 in 0.280s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:03 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info is being set with open permissions: ugo+rw Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:03 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info Jul 21 17:34:03 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:03 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.info" returned: 0 in 0.241s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:03 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:03 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-e8ca4c2a-b640-4aed-9261-3e151328aa8e tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:34:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-97c2e740-cb00-4ebf-b4b8-e966154d5798-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Lock "cinder-97c2e740-cb00-4ebf-b4b8-e966154d5798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:04 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-97c2e740-cb00-4ebf-b4b8-e966154d5798" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-97c2e740-cb00-4ebf-b4b8-e966154d5798" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot 97c2e740-cb00-4ebf-b4b8-e966154d5798 of volume 1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d95498-f43c-40aa-9ac3-6b5836ad3975]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:05 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 Jul 21 17:34:05 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:05 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058a184-4449-48cf-b306-e4c3fda3378e]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:05 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 Jul 21 17:34:05 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:05 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" returned: 0 in 0.362s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:05 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:05 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 Jul 21 17:34:05 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:06 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798" returned: 0 in 0.377s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:06 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798 Jul 21 17:34:06 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:06 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0.97c2e740-cb00-4ebf-b4b8-e966154d5798" returned: 0 in 0.285s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-97c2e740-cb00-4ebf-b4b8-e966154d5798" released by "_delete_snapshot" :: held 1.508s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" released by "delete_snapshot" :: held 1.532s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Created reservations ['7bf00fc2-a6bb-4323-91df-2c775991bfc2', 'c8ed460d-f75e-4d49-88e0-548a68add896', 'ad076637-0ba1-43ab-b0d0-f2277984c5d3', '10897bf1-a4d6-4dde-98cb-95bfc5fb96bc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:06 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:34:06 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-34c88c94-7454-45e6-9111-08e6828f7dde tempest-ProjectMemberTests-1964957264 None] Lock "cinder-97c2e740-cb00-4ebf-b4b8-e966154d5798-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-1caeb1be-b3aa-4daf-9cf9-55296ce770a0-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-1caeb1be-b3aa-4daf-9cf9-55296ce770a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5b8c54-6d4f-4844-a55b-4abe0e053c58]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:07 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 Jul 21 17:34:07 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:07 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" returned: 0 in 0.371s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:07 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0 Jul 21 17:34:07 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:07 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" returned: 0 in 0.260s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-1caeb1be-b3aa-4daf-9cf9-55296ce770a0" released by "delete_volume" :: held 0.701s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:07 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Created reservations ['92f7c50c-fe22-40f5-b5b1-cf7bb8553859', '92515340-02f1-471e-b84a-b1018e506369', '8b517c0c-87fc-4b65-991e-800ce39cb60d', '16f5b5fc-d0ec-40a4-9cb8-1219da15099e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:08 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:08 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:08 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.270s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:08 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-98b1b1a6-e197-44e7-9796-1e331f497cd3 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-1caeb1be-b3aa-4daf-9cf9-55296ce770a0-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (2d82158e-214d-4ac8-b42b-d43279b5da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1751892-00b8-4b07-a992-adec6857119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1751892-00b8-4b07-a992-adec6857119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1722254907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d9d2c2-4b8b-4186-b074-e0e3489c96ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:09Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b853518a-18e4-43a8-9e27-1c0bfd39d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b853518a-18e4-43a8-9e27-1c0bfd39d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc87ecd8-ee19-40bd-99d8-2f7b27bf4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc87ecd8-ee19-40bd-99d8-2f7b27bf4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d9d2c2-4b8b-4186-b074-e0e3489c96ee', 'volume_name': 'volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0337ba-f9dc-44b6-8bea-38bde22bf9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0337ba-f9dc-44b6-8bea-38bde22bf9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d424d6-36f1-4bd9-a081-4c9c6820dc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:08 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Volume 95d9d2c2-4b8b-4186-b074-e0e3489c96ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee', 'volume_size': 1} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1722254907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d9d2c2-4b8b-4186-b074-e0e3489c96ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:09Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Creating volume 95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:08 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:08 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee 1073741824 Jul 21 17:34:08 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:09 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee 1073741824" returned: 0 in 0.471s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:09 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee Jul 21 17:34:09 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:09 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" returned: 0 in 0.262s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d424d6-36f1-4bd9-a081-4c9c6820dc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06059066-0be6-4c9f-845a-9c6619a4e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:09 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Volume volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee (95d9d2c2-4b8b-4186-b074-e0e3489c96ee): created successfully Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06059066-0be6-4c9f-845a-9c6619a4e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:09 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (2d82158e-214d-4ac8-b42b-d43279b5da8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:09 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-c6d87f0f-f0a0-495c-ba77-36f2d3731eaf tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot a24e4cac-7916-49b5-9c19-c2c0beba7c52 of volume 95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6460e147-7c21-46ad-ac74-d3d82d3a906b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:10 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee Jul 21 17:34:10 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:10 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" returned: 0 in 0.383s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:10 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 1G Jul 21 17:34:10 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:10 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 1G" returned: 0 in 0.463s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:10 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:10 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 Jul 21 17:34:10 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:11 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52" returned: 0 in 0.309s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:11 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 is being set with open permissions: ugo+rw Jul 21 17:34:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:11 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 Jul 21 17:34:11 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:11 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52" returned: 0 in 0.255s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:11 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info Jul 21 17:34:11 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:11 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info" returned: 0 in 0.269s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:11 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info is being set with open permissions: ugo+rw Jul 21 17:34:11 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:11 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info Jul 21 17:34:11 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:12 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.info" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:12 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=168,cinder:INSERT=62,cinder:UPDATE=230,cinder:DELETE=17 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:34:12 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-591842a1-8b0c-4a6d-b9e3-d060d53c48fd tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:34:12 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=218,cinder:SELECT=181,cinder:DELETE=20,cinder:INSERT=60 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-a24e4cac-7916-49b5-9c19-c2c0beba7c52-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (181f0570-479d-41a2-8916-e849d33af51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41178a64-681d-4c83-bdb2-221e81a84a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Lock "cinder-a24e4cac-7916-49b5-9c19-c2c0beba7c52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41178a64-681d-4c83-bdb2-221e81a84a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873911329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdeac03-5ae3-4700-9150-007c7d0deb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:13Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca9ec9b-537c-4471-a046-5e6161921113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca9ec9b-537c-4471-a046-5e6161921113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d53f466-2f59-46e2-bffa-681614b8fbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d53f466-2f59-46e2-bffa-681614b8fbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efdeac03-5ae3-4700-9150-007c7d0deb21', 'volume_name': 'volume-efdeac03-5ae3-4700-9150-007c7d0deb21', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7fcc3b-a940-4244-8110-69c869dbd570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7fcc3b-a940-4244-8110-69c869dbd570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e8cd62-4aae-4ff6-a22e-4628adacad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:13 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Volume efdeac03-5ae3-4700-9150-007c7d0deb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efdeac03-5ae3-4700-9150-007c7d0deb21', 'volume_size': 1} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873911329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdeac03-5ae3-4700-9150-007c7d0deb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:13Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Creating volume efdeac03-5ae3-4700-9150-007c7d0deb21 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:13 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-a24e4cac-7916-49b5-9c19-c2c0beba7c52" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:13 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 1073741824 Jul 21 17:34:13 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-a24e4cac-7916-49b5-9c19-c2c0beba7c52" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot a24e4cac-7916-49b5-9c19-c2c0beba7c52 of volume 95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a080c965-ee49-419d-89bf-875ab1dc7c1c]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:13 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 Jul 21 17:34:13 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:13 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 1073741824" returned: 0 in 0.435s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:13 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52" returned: 0 in 0.375s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dececa0e-5f96-440d-8587-9469d22f0309]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:13 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:13 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 Jul 21 17:34:13 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:13 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee Jul 21 17:34:13 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:14 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21" returned: 0 in 0.245s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e8cd62-4aae-4ff6-a22e-4628adacad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efdeac03-5ae3-4700-9150-007c7d0deb21', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df61e66-1b29-48f0-a7e3-54c0968daaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:14 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Volume volume-efdeac03-5ae3-4700-9150-007c7d0deb21 (efdeac03-5ae3-4700-9150-007c7d0deb21): created successfully Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df61e66-1b29-48f0-a7e3-54c0968daaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (181f0570-479d-41a2-8916-e849d33af51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2fe8e92a-e631-4be5-8f98-3c69fd04849c tempest-ProjectReaderTests-859314758 None] Created volume successfully. Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" returned: 0 in 0.379s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:14 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:14 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 Jul 21 17:34:14 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-efdeac03-5ae3-4700-9150-007c7d0deb21-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Lock "cinder-efdeac03-5ae3-4700-9150-007c7d0deb21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-quobyte-efdeac03-5ae3-4700-9150-007c7d0deb21" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-efdeac03-5ae3-4700-9150-007c7d0deb21" acquired by "delete_volume" :: waited 0.022s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d759bf-5c33-4c62-bf87-2c2a218fc502]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:14 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52" returned: 0 in 0.393s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:14 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52 Jul 21 17:34:14 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:14 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 Jul 21 17:34:14 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:14 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee.a24e4cac-7916-49b5-9c19-c2c0beba7c52" returned: 0 in 0.241s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-a24e4cac-7916-49b5-9c19-c2c0beba7c52" released by "_delete_snapshot" :: held 1.482s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" released by "delete_snapshot" :: held 1.513s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Created reservations ['f798d1d8-56cf-4682-a3e8-5165c476119b', '67309791-85e5-42dd-ab63-4ffba992df7a', 'f910c8f4-3081-4335-a526-2a5a56bd208b', 'a5b258ec-f8b2-4dfb-8f8c-e2dff0f5b3c5'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:14 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21" returned: 0 in 0.374s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:14 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21 Jul 21 17:34:14 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:14 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:34:14 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-a6cd5c31-3628-4abc-9c3a-c451a549c19d tempest-ProjectMemberTests-1964957264 None] Lock "cinder-a24e4cac-7916-49b5-9c19-c2c0beba7c52-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:15 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-efdeac03-5ae3-4700-9150-007c7d0deb21" returned: 0 in 0.241s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-efdeac03-5ae3-4700-9150-007c7d0deb21" released by "delete_volume" :: held 0.661s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Created reservations ['95f42cf3-4a9a-4c06-9712-17aeea808434', 'f46151b3-370f-407a-b12e-0b48cb991991', '610356f1-eee9-4705-9f08-64669cdc1561', 'c7dfa46d-db49-455b-b8a5-f938aa7747ce'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:15 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:15 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-95d9d2c2-4b8b-4186-b074-e0e3489c96ee-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-95d9d2c2-4b8b-4186-b074-e0e3489c96ee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e763046-45da-4fe6-8864-04d2837e72c3]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:15 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.276s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:15 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Deleted volume successfully. Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-42f4a22f-7f3f-494d-8564-19084c90c7cd tempest-ProjectReaderTests-859314758 None] Lock "cinder-efdeac03-5ae3-4700-9150-007c7d0deb21-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:15 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee Jul 21 17:34:15 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:15 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:15 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:15 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee Jul 21 17:34:15 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (447ed920-e9bc-41c0-b476-5ad191967ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae62b38-6ff4-4eff-bf9d-acc68a57224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae62b38-6ff4-4eff-bf9d-acc68a57224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707315004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:16Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2ce5c2-b534-4f4f-8d0f-4538fd185783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2ce5c2-b534-4f4f-8d0f-4538fd185783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbca67d0-a10d-4c3a-9d9c-b6f2d3b24bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbca67d0-a10d-4c3a-9d9c-b6f2d3b24bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4', 'volume_name': 'volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fbc160-7f16-408a-b89f-7a6991aa66cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:16 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fbc160-7f16-408a-b89f-7a6991aa66cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784fdb1f-5acc-4fe9-a267-0f6eb76d6f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Volume 451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4', 'volume_size': 1} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707315004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:16Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Creating volume 451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:16 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" returned: 0 in 0.284s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:16 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 1073741824 Jul 21 17:34:16 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-95d9d2c2-4b8b-4186-b074-e0e3489c96ee" released by "delete_volume" :: held 0.755s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Created reservations ['bb91b907-086d-43f9-82b1-43c2f13cd6dc', 'f6b0df09-a8fe-4aac-b8a8-fbda9b821e39', '73b4b400-3437-4fd8-aa5f-9c7a06dd95de', '76ce5322-0457-4b92-8a65-07abe6f0455a'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:16 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:16 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:16 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-25cf527c-2c4a-406b-85e4-beb8b1f73b9f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-95d9d2c2-4b8b-4186-b074-e0e3489c96ee-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:16 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 1073741824" returned: 0 in 0.477s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:16 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 Jul 21 17:34:16 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:16 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784fdb1f-5acc-4fe9-a267-0f6eb76d6f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68f0e8a-b414-4ada-b00d-1a5026cba245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:16 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Volume volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 (451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4): created successfully Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68f0e8a-b414-4ada-b00d-1a5026cba245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (447ed920-e9bc-41c0-b476-5ad191967ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:16 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-5267eaa4-a8fe-481a-8b79-e9faeeddc0a1 tempest-ProjectReaderTests-859314758 None] Created volume successfully. Jul 21 17:34:16 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (da883030-1cf0-4b06-b7d7-65f49018350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc90caff-f59d-4608-8352-53f7a5c11217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc90caff-f59d-4608-8352-53f7a5c11217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906711153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d788ffb-4270-4d2d-ad3f-28915733f82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:17Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342b1cde-6e07-4f33-9f3d-524a239001d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342b1cde-6e07-4f33-9f3d-524a239001d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455e6649-c629-4723-a304-b12dd16be88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455e6649-c629-4723-a304-b12dd16be88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d788ffb-4270-4d2d-ad3f-28915733f82f', 'volume_name': 'volume-6d788ffb-4270-4d2d-ad3f-28915733f82f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb45fe2d-5d15-4eb0-9a02-e89e819c8759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb45fe2d-5d15-4eb0-9a02-e89e819c8759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad5c2c1-9be6-49e0-a590-e4219dcda353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Volume 6d788ffb-4270-4d2d-ad3f-28915733f82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d788ffb-4270-4d2d-ad3f-28915733f82f', 'volume_size': 1} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906711153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d788ffb-4270-4d2d-ad3f-28915733f82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:17Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Creating volume 6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:17 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:17 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f 1073741824 Jul 21 17:34:17 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Lock "cinder-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-quobyte-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4" acquired by "delete_volume" :: waited 0.013s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb78606c-1c19-4b68-a361-9cd7227fe92a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:17 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 Jul 21 17:34:17 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:17 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f 1073741824" returned: 0 in 0.413s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:17 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f Jul 21 17:34:17 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:17 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4" returned: 0 in 0.393s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:17 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4 Jul 21 17:34:17 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:17 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad5c2c1-9be6-49e0-a590-e4219dcda353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d788ffb-4270-4d2d-ad3f-28915733f82f', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9699682-4b21-4ee3-b5ba-f8c2e5637d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:17 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Volume volume-6d788ffb-4270-4d2d-ad3f-28915733f82f (6d788ffb-4270-4d2d-ad3f-28915733f82f): created successfully Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9699682-4b21-4ee3-b5ba-f8c2e5637d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (da883030-1cf0-4b06-b7d7-65f49018350f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:17 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:17 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9c134dc3-a82c-4a83-8a04-6d7c0262dae2 tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4" released by "delete_volume" :: held 0.682s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Created reservations ['42f5bca6-775f-496a-836a-666b6e2efaae', '30e9f8a5-961e-4863-82fd-fd998cda931d', 'a5b9db90-e2f1-4bb1-a39b-d076aa5b2e0f', '9bbdee78-d0ae-4716-b656-04588c17ac2b'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:17 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:18 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:18 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot 8121c39b-59c5-4c6a-9e14-400866ee3259 of volume 6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9f9b46-bc19-4e7f-9518-01ae90286406]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:18 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.253s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:18 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Deleted volume successfully. Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6666aa16-da14-4613-8e19-3bd23ef66e90 tempest-ProjectReaderTests-859314758 None] Lock "cinder-451225f5-a1a5-4f9f-9c85-ea8eeaf1ffa4-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:18 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f Jul 21 17:34:18 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:18 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f" returned: 0 in 0.400s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:18 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 1G Jul 21 17:34:18 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (d862dae2-8da8-4600-b0bd-591377baadfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a542cfc-97db-476e-99a4-17f57f1f1d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a542cfc-97db-476e-99a4-17f57f1f1d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103246175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11540a99-6653-407a-b6e5-ba002f17e14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:19Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa45071-7fa5-4746-8087-cb7ba9b7e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa45071-7fa5-4746-8087-cb7ba9b7e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2542b6-1e62-43dd-8d03-98cd300f44e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2542b6-1e62-43dd-8d03-98cd300f44e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11540a99-6653-407a-b6e5-ba002f17e14b', 'volume_name': 'volume-11540a99-6653-407a-b6e5-ba002f17e14b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7c257c-5aaf-45ae-bd48-5b989013abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7c257c-5aaf-45ae-bd48-5b989013abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837cc2b0-dab4-440b-bc62-32bad2d79073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:18 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Volume 11540a99-6653-407a-b6e5-ba002f17e14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11540a99-6653-407a-b6e5-ba002f17e14b', 'volume_size': 1} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:18 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 1G" returned: 0 in 0.386s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:18 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d788ffb-4270-4d2d-ad3f-28915733f82f -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:19 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d788ffb-4270-4d2d-ad3f-28915733f82f -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 Jul 21 17:34:19 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:19 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d788ffb-4270-4d2d-ad3f-28915733f82f -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259" returned: 0 in 0.282s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:19 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 is being set with open permissions: ugo+rw Jul 21 17:34:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:19 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 Jul 21 17:34:19 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:19 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:19 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info Jul 21 17:34:19 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:19 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info" returned: 0 in 0.244s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:19 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info is being set with open permissions: ugo+rw Jul 21 17:34:19 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:19 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info Jul 21 17:34:19 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:20 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.info" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103246175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11540a99-6653-407a-b6e5-ba002f17e14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:19Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Creating volume 11540a99-6653-407a-b6e5-ba002f17e14b {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:20 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:20 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b 1073741824 Jul 21 17:34:20 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-2a125010-824c-4f06-bd3b-20e85086cf0c tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-8121c39b-59c5-4c6a-9e14-400866ee3259-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-8121c39b-59c5-4c6a-9e14-400866ee3259-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-6d788ffb-4270-4d2d-ad3f-28915733f82f" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-6d788ffb-4270-4d2d-ad3f-28915733f82f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-8121c39b-59c5-4c6a-9e14-400866ee3259" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-8121c39b-59c5-4c6a-9e14-400866ee3259" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot 8121c39b-59c5-4c6a-9e14-400866ee3259 of volume 6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a6332-2bd6-4e34-9016-e0cc4a686eb1]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:20 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b 1073741824" returned: 0 in 0.459s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:20 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 Jul 21 17:34:20 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:20 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b Jul 21 17:34:20 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:20 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259" returned: 0 in 0.380s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d788ffb-4270-4d2d-ad3f-28915733f82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd099a2a-f37d-4491-8821-a8f3133a08f9]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:20 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b" returned: 0 in 0.266s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837cc2b0-dab4-440b-bc62-32bad2d79073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11540a99-6653-407a-b6e5-ba002f17e14b', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d18f609-ebb2-489b-872e-fefb231e9899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:20 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Volume volume-11540a99-6653-407a-b6e5-ba002f17e14b (11540a99-6653-407a-b6e5-ba002f17e14b): created successfully Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d18f609-ebb2-489b-872e-fefb231e9899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:20 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (d862dae2-8da8-4600-b0bd-591377baadfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:20 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-effedfb9-8c7d-45d4-93f6-3d9ced0f9feb tempest-ProjectReaderTests-859314758 None] Created volume successfully. Jul 21 17:34:20 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f Jul 21 17:34:20 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:21 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f" returned: 0 in 0.346s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:21 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 Jul 21 17:34:21 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:21 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259" returned: 0 in 0.336s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:21 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259 Jul 21 17:34:21 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:21 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f.8121c39b-59c5-4c6a-9e14-400866ee3259" returned: 0 in 0.242s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-8121c39b-59c5-4c6a-9e14-400866ee3259" released by "_delete_snapshot" :: held 1.393s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-6d788ffb-4270-4d2d-ad3f-28915733f82f" released by "delete_snapshot" :: held 1.416s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Created reservations ['94acadf4-83b5-409d-a59c-366dd1129c14', '2c939961-251f-4e1c-be74-92194d62eb9f', 'a7e77c84-7406-4881-8df0-c287ee28569c', '2a5e8ca6-2877-4b6c-befc-64a56891c4cc'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:21 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-6e1eb059-b1a5-4d3b-b92c-5e46047ad84f tempest-ProjectMemberTests-1964957264 None] Lock "cinder-8121c39b-59c5-4c6a-9e14-400866ee3259-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-11540a99-6653-407a-b6e5-ba002f17e14b-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Lock "cinder-11540a99-6653-407a-b6e5-ba002f17e14b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-quobyte-11540a99-6653-407a-b6e5-ba002f17e14b" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:21 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-11540a99-6653-407a-b6e5-ba002f17e14b" acquired by "delete_volume" :: waited 0.014s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9d2c8-eee4-403c-93da-d9ab2dabab81]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:22 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b Jul 21 17:34:22 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:22 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b" returned: 0 in 0.344s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:22 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b Jul 21 17:34:22 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-6d788ffb-4270-4d2d-ad3f-28915733f82f-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-6d788ffb-4270-4d2d-ad3f-28915733f82f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-6d788ffb-4270-4d2d-ad3f-28915733f82f" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-6d788ffb-4270-4d2d-ad3f-28915733f82f" acquired by "delete_volume" :: waited 0.023s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2e5c9-b3c2-4984-8d50-c31c0ded047a]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:22 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-11540a99-6653-407a-b6e5-ba002f17e14b" returned: 0 in 0.255s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-11540a99-6653-407a-b6e5-ba002f17e14b" released by "delete_volume" :: held 0.638s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Created reservations ['d02ca93c-c340-4642-a26f-85bc3503a4d8', '8e0ddee5-8dc9-4542-9f79-3d990b30f02c', '56a8b9e9-ac77-4787-90dc-eba10197a19e', 'dc00f79c-b5d1-476a-9176-58ad9ef1442f'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:22 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f Jul 21 17:34:22 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:22 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:22 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:22 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f" returned: 0 in 0.376s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:22 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.237s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:22 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f Jul 21 17:34:22 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:22 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Deleted volume successfully. Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-377bfac9-a8f5-42c1-9f6e-40ed22c4f68d tempest-ProjectReaderTests-859314758 None] Lock "cinder-11540a99-6653-407a-b6e5-ba002f17e14b-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:23 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-6d788ffb-4270-4d2d-ad3f-28915733f82f" returned: 0 in 0.246s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-6d788ffb-4270-4d2d-ad3f-28915733f82f" released by "delete_volume" :: held 0.681s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Created reservations ['70f4374d-cd94-4ad9-b3ca-b71b1321e6b7', '15e52082-f5d5-4694-8766-9b67374c4441', '88ddeb34-e146-4eb5-913a-7c92b1301b67', '995aba4e-ea86-43af-9ad8-3e3f58feff6e'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:23 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:23 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (37494fd5-47cb-4ee4-81fc-9da37c5416c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f05ee0c-5850-41e8-addd-be7f4d1c51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f05ee0c-5850-41e8-addd-be7f4d1c51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890230249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee615758-13c6-4cfc-a16e-c86b2699c419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:23Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3ed30d-bf33-42a5-9caa-cdfca5ed8c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3ed30d-bf33-42a5-9caa-cdfca5ed8c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:23 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a23106c-5f84-44a0-bc8b-0231475f32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a23106c-5f84-44a0-bc8b-0231475f32b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee615758-13c6-4cfc-a16e-c86b2699c419', 'volume_name': 'volume-ee615758-13c6-4cfc-a16e-c86b2699c419', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264a75cd-c9ea-4b1c-af6d-3c9bff3adb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264a75cd-c9ea-4b1c-af6d-3c9bff3adb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef755b30-facf-4de0-b627-a96c1cb01fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:23 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Volume ee615758-13c6-4cfc-a16e-c86b2699c419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee615758-13c6-4cfc-a16e-c86b2699c419', 'volume_size': 1} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890230249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee615758-13c6-4cfc-a16e-c86b2699c419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a0a8382364795a5da7640b41aaaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:23Z,use_quota=True,user_id='a5cbd9894d894e68bb937130ef9c4b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Creating volume ee615758-13c6-4cfc-a16e-c86b2699c419 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:23 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.293s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:23 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:34:23 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 1073741824 Jul 21 17:34:23 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:23 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-253cca4b-f249-4c30-891b-7aa04cfbe556 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-6d788ffb-4270-4d2d-ad3f-28915733f82f-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 17:34:24 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (9a4a5ead-a0f1-4cda-bb6e-f6c35e8444d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84946ae0-9782-48da-b40c-9251f9aa2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 1073741824" returned: 0 in 0.482s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84946ae0-9782-48da-b40c-9251f9aa2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721274739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8295cc-f123-441b-92c4-2c8e879b7940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:24Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459c8827-e265-4f95-92e0-6c378317c8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459c8827-e265-4f95-92e0-6c378317c8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01a0492-a3c5-4590-8086-9b2fb64f8e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01a0492-a3c5-4590-8086-9b2fb64f8e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8295cc-f123-441b-92c4-2c8e879b7940', 'volume_name': 'volume-0e8295cc-f123-441b-92c4-2c8e879b7940', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2d7c9e-c537-4709-bf62-17fc1c6cfb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2d7c9e-c537-4709-bf62-17fc1c6cfb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f44a87-23a6-49bb-bc18-6feb7f1c4803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Volume 0e8295cc-f123-441b-92c4-2c8e879b7940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8295cc-f123-441b-92c4-2c8e879b7940', 'volume_size': 1} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:24 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 Jul 21 17:34:24 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:24 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T15:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721274739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8295cc-f123-441b-92c4-2c8e879b7940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b350fd9214c4085b751fab54c4e00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T15:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T15:34:24Z,use_quota=True,user_id='869de82c143c4025bbf9438a2cc04e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33d380a7-c9ab-4ac6-b825-5d55112859dc),volume_type_id=33d380a7-c9ab-4ac6-b825-5d55112859dc)}" {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Creating volume 0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Selected osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 as target Quobyte volume. {{(pid=87591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 17:34:24 devstack cinder-volume[87591]: INFO cinder.volume.drivers.remotefs [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] casted to osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6 Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 1073741824 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef755b30-facf-4de0-b627-a96c1cb01fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee615758-13c6-4cfc-a16e-c86b2699c419', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea93b4a-2c27-40ef-9cac-5fddaa09de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:24 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 1073741824 Jul 21 17:34:24 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:24 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Volume volume-ee615758-13c6-4cfc-a16e-c86b2699c419 (ee615758-13c6-4cfc-a16e-c86b2699c419): created successfully Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea93b4a-2c27-40ef-9cac-5fddaa09de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Flow 'volume_create_manager' (37494fd5-47cb-4ee4-81fc-9da37c5416c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:24 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-491bb286-8cda-4d73-9f9e-3ac9e97bb4a2 tempest-ProjectReaderTests-859314758 None] Created volume successfully. Jul 21 17:34:24 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 1073741824" returned: 0 in 0.437s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:24 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:24 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 Jul 21 17:34:24 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:25 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940" returned: 0 in 0.234s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'} {{(pid=87591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f44a87-23a6-49bb-bc18-6feb7f1c4803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8295cc-f123-441b-92c4-2c8e879b7940', 'volume_size': 1}' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2ccfc0-7ba9-4d49-a2a4-95ac55744d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 17:34:25 devstack cinder-volume[87591]: INFO cinder.volume.flows.manager.create_volume [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Volume volume-0e8295cc-f123-441b-92c4-2c8e879b7940 (0e8295cc-f123-441b-92c4-2c8e879b7940): created successfully Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2ccfc0-7ba9-4d49-a2a4-95ac55744d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Flow 'volume_create_manager' (9a4a5ead-a0f1-4cda-bb6e-f6c35e8444d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 17:34:25 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-9126dbb7-35f6-4e82-9db1-1917e52351bd tempest-ProjectMemberTests-1964957264 None] Created volume successfully. Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-ee615758-13c6-4cfc-a16e-c86b2699c419-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Lock "cinder-ee615758-13c6-4cfc-a16e-c86b2699c419-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Acquiring lock "cinder-quobyte-ee615758-13c6-4cfc-a16e-c86b2699c419" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-ee615758-13c6-4cfc-a16e-c86b2699c419" acquired by "delete_volume" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d68bb-1848-4637-a16c-0b63822934de]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:25 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:25 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 Jul 21 17:34:25 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:26 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419" returned: 0 in 0.367s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:26 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419 Jul 21 17:34:26 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Creating offline snapshot 152b9769-d044-4891-ac8e-9bcffbc9a69b of volume 0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 17:34:26 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-ee615758-13c6-4cfc-a16e-c86b2699c419" returned: 0 in 0.274s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12acb5-a1d8-4078-94b5-8f5a571aed6f]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Lock "cinder-quobyte-ee615758-13c6-4cfc-a16e-c86b2699c419" released by "delete_volume" :: held 0.689s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Created reservations ['2b1170bf-1144-4b70-a344-a26acb5f0589', 'ec822fd1-dff5-491a-aed0-3ca7b97a037d', '371e17e7-5883-49e3-b5ec-f92d008e6144', 'a3c6e1a2-2fec-4371-b0b1-a9425056baff'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:26 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 Jul 21 17:34:26 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:26 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:26 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:26 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940" returned: 0 in 0.356s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b 1G {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:26 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b 1G Jul 21 17:34:26 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:26 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.258s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:26 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Deleted volume successfully. Jul 21 17:34:26 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-67bf03a4-a51e-44c6-be68-885fa401ad55 tempest-ProjectReaderTests-859314758 None] Lock "cinder-ee615758-13c6-4cfc-a16e-c86b2699c419-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:27 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b 1G" returned: 0 in 0.409s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e8295cc-f123-441b-92c4-2c8e879b7940 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:27 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e8295cc-f123-441b-92c4-2c8e879b7940 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b Jul 21 17:34:27 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:27 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e8295cc-f123-441b-92c4-2c8e879b7940 -F qcow2 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b" returned: 0 in 0.299s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:27 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b is being set with open permissions: ugo+rw Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:27 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b Jul 21 17:34:27 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:27 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b" returned: 0 in 0.261s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:27 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info Jul 21 17:34:27 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:27 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info" returned: 0 in 0.257s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:27 devstack cinder-volume[87591]: WARNING cinder.volume.drivers.remotefs [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info is being set with open permissions: ugo+rw Jul 21 17:34:27 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:28 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info Jul 21 17:34:28 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:28 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.info" returned: 0 in 0.265s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:28 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-82b13a76-2455-455c-b0d5-be964b9b7f34 tempest-ProjectMemberTests-1964957264 None] Create snapshot completed successfully Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-152b9769-d044-4891-ac8e-9bcffbc9a69b-delete_snapshot" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-152b9769-d044-4891-ac8e-9bcffbc9a69b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-0e8295cc-f123-441b-92c4-2c8e879b7940" by "delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-0e8295cc-f123-441b-92c4-2c8e879b7940" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-152b9769-d044-4891-ac8e-9bcffbc9a69b" by "_delete_snapshot" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-152b9769-d044-4891-ac8e-9bcffbc9a69b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Deleting offline snapshot 152b9769-d044-4891-ac8e-9bcffbc9a69b of volume 0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] snapshot_file for this snap is: volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b {{(pid=87591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669dfaf-7796-450a-b04c-c2946718c442]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:28 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:28 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b Jul 21 17:34:28 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:29 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b" returned: 0 in 0.339s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e8295cc-f123-441b-92c4-2c8e879b7940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[68855019-da3b-463a-ae00-c2608d9c9f5d]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:29 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 Jul 21 17:34:29 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:29 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940" returned: 0 in 0.339s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:29 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b Jul 21 17:34:29 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:29 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b" returned: 0 in 0.330s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:29 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b Jul 21 17:34:29 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:29 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940.152b9769-d044-4891-ac8e-9bcffbc9a69b" returned: 0 in 0.230s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:29 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-152b9769-d044-4891-ac8e-9bcffbc9a69b" released by "_delete_snapshot" :: held 1.323s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-0e8295cc-f123-441b-92c4-2c8e879b7940" released by "delete_snapshot" :: held 1.346s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Created reservations ['af873a3c-19ff-436d-9c1c-6fd91922d345', 'a5840f0a-4517-412a-a0ee-ab71b5903984', 'd24ff33a-da33-4b3d-98fc-68a19b653fed', 'f53cf34f-b95b-4905-8b6b-57909e44644d'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:30 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Delete snapshot completed successfully. Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-1bdf8a09-cb16-427e-8a2e-c830fd0ce138 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-152b9769-d044-4891-ac8e-9bcffbc9a69b-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-0e8295cc-f123-441b-92c4-2c8e879b7940-delete_volume" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-0e8295cc-f123-441b-92c4-2c8e879b7940-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "cinder-quobyte-0e8295cc-f123-441b-92c4-2c8e879b7940" by "delete_volume" {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-0e8295cc-f123-441b-92c4-2c8e879b7940" acquired by "delete_volume" :: waited 0.017s {{(pid=87591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b219fb-e1c5-499e-9a1e-feecdb51069b]: (4, 'qcow2') {{(pid=88752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 17:34:30 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:30 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 Jul 21 17:34:30 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:31 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940" returned: 0 in 0.337s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:31 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940 Jul 21 17:34:31 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:31 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4/volume-0e8295cc-f123-441b-92c4-2c8e879b7940" returned: 0 in 0.246s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-quobyte-0e8295cc-f123-441b-92c4-2c8e879b7940" released by "delete_volume" :: held 0.637s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG cinder.quota [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Created reservations ['6b8fc5e5-db5a-4d04-b395-9dd193cdecda', 'd814e0f1-a075-4838-bfda-d646b29286a3', '45548adc-53ad-414d-a21a-9da1fc360158', 'f8b53690-dbd7-49bd-af19-eff13742fb14'] {{(pid=87591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:31 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:31 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:31 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.252s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:31 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Deleted volume successfully. Jul 21 17:34:31 devstack cinder-volume[87591]: DEBUG cinder.coordination [None req-3635e37a-c8c7-4b04-ad9a-8734e6993807 tempest-ProjectMemberTests-1964957264 None] Lock "cinder-0e8295cc-f123-441b-92c4-2c8e879b7940-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 17:34:41 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:UPDATE=93,cinder:SELECT=61,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:34:41 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writing DB stats cinder:SELECT=70,cinder:UPDATE=94,cinder:DELETE=10,cinder:INSERT=26 {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6': None} {{(pid=87591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG cinder.volume.drivers.quobyte [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f3dd9b1e-249e-4b48-8a5b-cd08338f5db6'] {{(pid=87591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 17:34:42 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4 Jul 21 17:34:42 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 17:34:42 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_concurrency.processutils [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc94fa4fa8e4dcba58eee057755504d4" returned: 0 in 0.243s {{(pid=87591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG cinder.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Notifying Schedulers of capabilities ... {{(pid=87591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG oslo_service.periodic_task [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] Running periodic task VolumeManager._thread_info {{(pid=87591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread count: 28 {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 17:34:42 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-5e89af6f-6f45-48fa-afe0-60f1ccc61751 None None] thread info: [<_MainThread(MainThread, started 125961673896064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}